2026-03-13 12:30:11.141078+00:00 [notice] <0.230.0> Logging: configured log handlers are now ACTIVE 2026-03-13 12:30:11.373493+00:00 [info] <0.230.0> ra: starting system quorum_queues 2026-03-13 12:30:11.373562+00:00 [info] <0.230.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/rabbit@np0000158678/quorum/rabbit@np0000158678 2026-03-13 12:30:11.427358+00:00 [info] <0.262.0> ra system 'quorum_queues' running pre init for 0 registered servers 2026-03-13 12:30:11.437222+00:00 [info] <0.263.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered 2026-03-13 12:30:11.450223+00:00 [notice] <0.268.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables 2026-03-13 12:30:11.472490+00:00 [info] <0.230.0> ra: starting system coordination 2026-03-13 12:30:11.472535+00:00 [info] <0.230.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/rabbit@np0000158678/coordination/rabbit@np0000158678 2026-03-13 12:30:11.473856+00:00 [info] <0.275.0> ra system 'coordination' running pre init for 0 registered servers 2026-03-13 12:30:11.474578+00:00 [info] <0.276.0> ra: meta data store initialised for system coordination. 0 record(s) recovered 2026-03-13 12:30:11.474682+00:00 [notice] <0.281.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables 2026-03-13 12:30:11.583645+00:00 [info] <0.230.0> 2026-03-13 12:30:11.583645+00:00 [info] <0.230.0> Starting RabbitMQ 3.12.1 on Erlang 25.3.2.8 [jit] 2026-03-13 12:30:11.583645+00:00 [info] <0.230.0> Copyright (c) 2007-2023 VMware, Inc. or its affiliates. 2026-03-13 12:30:11.583645+00:00 [info] <0.230.0> Licensed under the MPL 2.0. Website: https://rabbitmq.com 2026-03-13 12:30:11.585482+00:00 [info] <0.230.0> 2026-03-13 12:30:11.585482+00:00 [info] <0.230.0> node : rabbit@np0000158678 2026-03-13 12:30:11.585482+00:00 [info] <0.230.0> home dir : /var/lib/rabbitmq 2026-03-13 12:30:11.585482+00:00 [info] <0.230.0> config file(s) : (none) 2026-03-13 12:30:11.585482+00:00 [info] <0.230.0> cookie hash : BD3GADNlTiCqXvoEKM49lQ== 2026-03-13 12:30:11.585482+00:00 [info] <0.230.0> log(s) : /var/log/rabbitmq/rabbit@np0000158678.log 2026-03-13 12:30:11.585482+00:00 [info] <0.230.0> : 2026-03-13 12:30:11.585482+00:00 [info] <0.230.0> data dir : /var/lib/rabbitmq/mnesia/rabbit@np0000158678 2026-03-13 12:30:13.890656+00:00 [info] <0.230.0> Running boot step pre_boot defined by app rabbit 2026-03-13 12:30:13.890787+00:00 [info] <0.230.0> Running boot step rabbit_global_counters defined by app rabbit 2026-03-13 12:30:13.891144+00:00 [info] <0.230.0> Running boot step rabbit_osiris_metrics defined by app rabbit 2026-03-13 12:30:13.891294+00:00 [info] <0.230.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-03-13 12:30:13.893123+00:00 [info] <0.230.0> Running boot step rabbit_alarm defined by app rabbit 2026-03-13 12:30:13.902059+00:00 [info] <0.299.0> Memory high watermark set to 25720 MiB (26969815449 bytes) of 64301 MiB (67424538624 bytes) total 2026-03-13 12:30:13.908924+00:00 [info] <0.301.0> Enabling free disk space monitoring (disk free space: 283779620864, total memory: 67424538624) 2026-03-13 12:30:13.908998+00:00 [info] <0.301.0> Disk free limit set to 50MB 2026-03-13 12:30:13.912381+00:00 [info] <0.230.0> Running boot step code_server_cache defined by app rabbit 2026-03-13 12:30:13.912531+00:00 [info] <0.230.0> Running boot step file_handle_cache defined by app rabbit 2026-03-13 12:30:13.912892+00:00 [info] <0.304.0> Limiting to approx 65439 file handles (58893 sockets) 2026-03-13 12:30:13.913060+00:00 [info] <0.305.0> FHC read buffering: OFF 2026-03-13 12:30:13.913120+00:00 [info] <0.305.0> FHC write buffering: ON 2026-03-13 12:30:13.913714+00:00 [info] <0.230.0> Running boot step worker_pool defined by app rabbit 2026-03-13 12:30:13.913855+00:00 [info] <0.283.0> Will use 16 processes for default worker pool 2026-03-13 12:30:13.913916+00:00 [info] <0.283.0> Starting worker pool 'worker_pool' with 16 processes in it 2026-03-13 12:30:13.915218+00:00 [info] <0.230.0> Running boot step database defined by app rabbit 2026-03-13 12:30:13.916153+00:00 [info] <0.230.0> Node database directory at /var/lib/rabbitmq/mnesia/rabbit@np0000158678 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-03-13 12:30:13.916239+00:00 [info] <0.230.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-03-13 12:30:13.916290+00:00 [info] <0.230.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-13 12:30:13.916361+00:00 [info] <0.230.0> All discovered existing cluster peers: 2026-03-13 12:30:13.916462+00:00 [info] <0.230.0> Discovered no peer nodes to cluster with. Some discovery backends can filter nodes out based on a readiness criteria. Enabling debug logging might help troubleshoot. 2026-03-13 12:30:13.920482+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped 2026-03-13 12:30:14.017559+00:00 [info] <0.230.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-13 12:30:14.017738+00:00 [info] <0.230.0> Successfully synced tables from a peer 2026-03-13 12:30:14.018347+00:00 [notice] <0.284.0> Feature flags: attempt to enable `stream_sac_coordinator_unblock_group`... 2026-03-13 12:30:14.052807+00:00 [notice] <0.284.0> Feature flags: `stream_sac_coordinator_unblock_group` enabled 2026-03-13 12:30:14.052962+00:00 [notice] <0.284.0> Feature flags: attempt to enable `restart_streams`... 2026-03-13 12:30:14.090689+00:00 [notice] <0.284.0> Feature flags: `restart_streams` enabled 2026-03-13 12:30:14.091408+00:00 [info] <0.230.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-13 12:30:14.091747+00:00 [info] <0.230.0> Successfully synced tables from a peer 2026-03-13 12:30:14.099946+00:00 [info] <0.230.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-13 12:30:14.100121+00:00 [info] <0.230.0> Successfully synced tables from a peer 2026-03-13 12:30:14.100173+00:00 [info] <0.230.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping registration. 2026-03-13 12:30:14.100333+00:00 [info] <0.230.0> Will try to unlock with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-13 12:30:14.100711+00:00 [info] <0.230.0> Running boot step tracking_metadata_store defined by app rabbit 2026-03-13 12:30:14.100941+00:00 [info] <0.494.0> Setting up a table for connection tracking on this node: tracked_connection 2026-03-13 12:30:14.101065+00:00 [info] <0.494.0> Setting up a table for per-vhost connection counting on this node: tracked_connection_per_vhost 2026-03-13 12:30:14.101210+00:00 [info] <0.494.0> Setting up a table for per-user connection counting on this node: tracked_connection_per_user 2026-03-13 12:30:14.101285+00:00 [info] <0.494.0> Setting up a table for channel tracking on this node: tracked_channel 2026-03-13 12:30:14.101431+00:00 [info] <0.494.0> Setting up a table for channel tracking on this node: tracked_channel_per_user 2026-03-13 12:30:14.101550+00:00 [info] <0.230.0> Running boot step networking_metadata_store defined by app rabbit 2026-03-13 12:30:14.101711+00:00 [info] <0.230.0> Running boot step feature_flags defined by app rabbit 2026-03-13 12:30:14.101993+00:00 [info] <0.230.0> Running boot step codec_correctness_check defined by app rabbit 2026-03-13 12:30:14.102090+00:00 [info] <0.230.0> Running boot step external_infrastructure defined by app rabbit 2026-03-13 12:30:14.102187+00:00 [info] <0.230.0> Running boot step rabbit_event defined by app rabbit 2026-03-13 12:30:14.102379+00:00 [info] <0.230.0> Running boot step rabbit_registry defined by app rabbit 2026-03-13 12:30:14.102523+00:00 [info] <0.230.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-03-13 12:30:14.102707+00:00 [info] <0.230.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-03-13 12:30:14.102940+00:00 [info] <0.230.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-03-13 12:30:14.103099+00:00 [info] <0.230.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-03-13 12:30:14.103250+00:00 [info] <0.230.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-03-13 12:30:14.103336+00:00 [info] <0.230.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-03-13 12:30:14.103406+00:00 [info] <0.230.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-03-13 12:30:14.103472+00:00 [info] <0.230.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-03-13 12:30:14.103593+00:00 [info] <0.230.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-03-13 12:30:14.103691+00:00 [info] <0.230.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-03-13 12:30:14.103826+00:00 [info] <0.230.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-03-13 12:30:14.103903+00:00 [info] <0.230.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-03-13 12:30:14.104035+00:00 [info] <0.230.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-03-13 12:30:14.104138+00:00 [info] <0.230.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-03-13 12:30:14.104222+00:00 [info] <0.230.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-03-13 12:30:14.104331+00:00 [info] <0.230.0> Running boot step kernel_ready defined by app rabbit 2026-03-13 12:30:14.104410+00:00 [info] <0.230.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-03-13 12:30:14.104635+00:00 [info] <0.230.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-03-13 12:30:14.106097+00:00 [info] <0.502.0> epmd monitor knows us, inter-node communication (distribution) port: 25672 2026-03-13 12:30:14.106289+00:00 [info] <0.230.0> Running boot step guid_generator defined by app rabbit 2026-03-13 12:30:14.109173+00:00 [info] <0.230.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-03-13 12:30:14.109568+00:00 [info] <0.506.0> Starting rabbit_node_monitor 2026-03-13 12:30:14.109743+00:00 [info] <0.230.0> Running boot step delegate_sup defined by app rabbit 2026-03-13 12:30:14.110259+00:00 [info] <0.230.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-03-13 12:30:14.110501+00:00 [info] <0.230.0> Running boot step rabbit_fifo_dlx_sup defined by app rabbit 2026-03-13 12:30:14.110590+00:00 [info] <0.230.0> Running boot step core_initialized defined by app rabbit 2026-03-13 12:30:14.110627+00:00 [info] <0.230.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit 2026-03-13 12:30:14.110712+00:00 [info] <0.230.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-03-13 12:30:14.110802+00:00 [info] <0.230.0> Running boot step rabbit_definitions_hashing defined by app rabbit 2026-03-13 12:30:14.110883+00:00 [info] <0.230.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-03-13 12:30:14.111196+00:00 [info] <0.230.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-03-13 12:30:14.111611+00:00 [info] <0.230.0> Running boot step rabbit_policies defined by app rabbit 2026-03-13 12:30:14.112064+00:00 [info] <0.230.0> Running boot step rabbit_policy defined by app rabbit 2026-03-13 12:30:14.112133+00:00 [info] <0.230.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-03-13 12:30:14.112234+00:00 [info] <0.230.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit 2026-03-13 12:30:14.112292+00:00 [info] <0.230.0> Running boot step rabbit_stream_coordinator defined by app rabbit 2026-03-13 12:30:14.112448+00:00 [info] <0.230.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-03-13 12:30:14.112570+00:00 [info] <0.230.0> Running boot step recovery defined by app rabbit 2026-03-13 12:30:14.113509+00:00 [info] <0.230.0> Running boot step empty_db_check defined by app rabbit 2026-03-13 12:30:14.113566+00:00 [info] <0.230.0> Will seed default virtual host and user... 2026-03-13 12:30:14.113712+00:00 [info] <0.230.0> Adding vhost '/' (description: 'Default virtual host', tags: []) 2026-03-13 12:30:14.115851+00:00 [info] <0.230.0> Inserted a virtual host record {vhost,<<"/">>,[], 2026-03-13 12:30:14.115851+00:00 [info] <0.230.0> #{description => 2026-03-13 12:30:14.115851+00:00 [info] <0.230.0> <<"Default virtual host">>, 2026-03-13 12:30:14.115851+00:00 [info] <0.230.0> tags => []}} 2026-03-13 12:30:14.131848+00:00 [info] <0.547.0> Making sure data directory '/var/lib/rabbitmq/mnesia/rabbit@np0000158678/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-03-13 12:30:14.133437+00:00 [info] <0.547.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048' 2026-03-13 12:30:14.138420+00:00 [info] <0.547.0> Starting message stores for vhost '/' 2026-03-13 12:30:14.138619+00:00 [info] <0.557.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-03-13 12:30:14.140217+00:00 [info] <0.547.0> Started message store of type transient for vhost '/' 2026-03-13 12:30:14.140379+00:00 [info] <0.561.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-03-13 12:30:14.141091+00:00 [warning] <0.561.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-03-13 12:30:14.142054+00:00 [info] <0.547.0> Started message store of type persistent for vhost '/' 2026-03-13 12:30:14.142187+00:00 [info] <0.547.0> Recovering 0 queues of type rabbit_classic_queue took 8ms 2026-03-13 12:30:14.142259+00:00 [info] <0.547.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms 2026-03-13 12:30:14.142342+00:00 [info] <0.547.0> Recovering 0 queues of type rabbit_stream_queue took 0ms 2026-03-13 12:30:14.145975+00:00 [info] <0.230.0> Created user 'guest' 2026-03-13 12:30:14.148036+00:00 [info] <0.230.0> Successfully set user tags for user 'guest' to [administrator] 2026-03-13 12:30:14.150236+00:00 [info] <0.230.0> Successfully set permissions for user 'guest' in virtual host '/' to '.*', '.*', '.*' 2026-03-13 12:30:14.150355+00:00 [info] <0.230.0> Running boot step rabbit_observer_cli defined by app rabbit 2026-03-13 12:30:14.150482+00:00 [info] <0.230.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-03-13 12:30:14.150580+00:00 [info] <0.230.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-03-13 12:30:14.150731+00:00 [info] <0.230.0> Running boot step background_gc defined by app rabbit 2026-03-13 12:30:14.150894+00:00 [info] <0.230.0> Running boot step routing_ready defined by app rabbit 2026-03-13 12:30:14.150979+00:00 [info] <0.230.0> Running boot step pre_flight defined by app rabbit 2026-03-13 12:30:14.151058+00:00 [info] <0.230.0> Running boot step notify_cluster defined by app rabbit 2026-03-13 12:30:14.151149+00:00 [info] <0.230.0> Running boot step networking defined by app rabbit 2026-03-13 12:30:14.151331+00:00 [info] <0.230.0> Running boot step definition_import_worker_pool defined by app rabbit 2026-03-13 12:30:14.151516+00:00 [info] <0.283.0> Starting worker pool 'definition_import_pool' with 16 processes in it 2026-03-13 12:30:14.152844+00:00 [info] <0.230.0> Running boot step cluster_name defined by app rabbit 2026-03-13 12:30:14.152972+00:00 [info] <0.230.0> Initialising internal cluster ID to 'rabbitmq-cluster-id-JU4BaUYSUxZV05ZfOuJTfg' 2026-03-13 12:30:14.155239+00:00 [info] <0.230.0> Running boot step direct_client defined by app rabbit 2026-03-13 12:30:14.155363+00:00 [info] <0.230.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit 2026-03-13 12:30:14.155412+00:00 [info] <0.230.0> Creating table rabbit_node_maintenance_states for maintenance mode status 2026-03-13 12:30:14.162196+00:00 [info] <0.611.0> Resetting node maintenance status 2026-03-13 12:30:14.162387+00:00 [info] <0.611.0> Ready to start client connection listeners 2026-03-13 12:30:14.165227+00:00 [info] <0.629.0> started TCP listener on [::]:5672 2026-03-13 12:30:14.247207+00:00 [info] <0.611.0> Server startup complete; 0 plugins started. 2026-03-13 12:30:17.395997+00:00 [info] <0.641.0> Created user 'stackrabbit' 2026-03-13 12:30:18.397585+00:00 [info] <0.648.0> Successfully set permissions for user 'stackrabbit' in virtual host '/' to '.*', '.*', '.*' 2026-03-13 12:30:19.200831+00:00 [info] <0.655.0> Successfully changed password for user 'stackrabbit' 2026-03-13 12:30:19.951786+00:00 [info] <0.662.0> Deleted user 'guest' 2026-03-13 12:30:19.952051+00:00 [info] <0.664.0> Closing all connections from user 'guest' because it's being deleted 2026-03-13 12:33:42.417032+00:00 [info] <0.706.0> Adding vhost 'nova_cell1' (description: '', tags: []) 2026-03-13 12:33:42.420648+00:00 [info] <0.706.0> Inserted a virtual host record {vhost,<<"nova_cell1">>,[], 2026-03-13 12:33:42.420648+00:00 [info] <0.706.0> #{description => <<>>,tags => []}} 2026-03-13 12:33:42.437345+00:00 [info] <0.718.0> Making sure data directory '/var/lib/rabbitmq/mnesia/rabbit@np0000158678/msg_stores/vhosts/6RTRUNKEABC4BKCG2P5ONFZRJ' for vhost 'nova_cell1' exists 2026-03-13 12:33:42.438617+00:00 [info] <0.718.0> Setting segment_entry_count for vhost 'nova_cell1' with 0 queues to '2048' 2026-03-13 12:33:42.444411+00:00 [info] <0.718.0> Starting message stores for vhost 'nova_cell1' 2026-03-13 12:33:42.444795+00:00 [info] <0.727.0> Message store "6RTRUNKEABC4BKCG2P5ONFZRJ/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-03-13 12:33:42.446666+00:00 [info] <0.718.0> Started message store of type transient for vhost 'nova_cell1' 2026-03-13 12:33:42.446891+00:00 [info] <0.731.0> Message store "6RTRUNKEABC4BKCG2P5ONFZRJ/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-03-13 12:33:42.447598+00:00 [warning] <0.731.0> Message store "6RTRUNKEABC4BKCG2P5ONFZRJ/msg_store_persistent": rebuilding indices from scratch 2026-03-13 12:33:42.449026+00:00 [info] <0.718.0> Started message store of type persistent for vhost 'nova_cell1' 2026-03-13 12:33:42.449210+00:00 [info] <0.718.0> Recovering 0 queues of type rabbit_classic_queue took 9ms 2026-03-13 12:33:42.449300+00:00 [info] <0.718.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms 2026-03-13 12:33:42.449355+00:00 [info] <0.718.0> Recovering 0 queues of type rabbit_stream_queue took 0ms 2026-03-13 12:33:43.130457+00:00 [info] <0.762.0> Successfully set permissions for user 'stackrabbit' in virtual host 'nova_cell1' to '.*', '.*', '.*'