2026-03-13 12:25:14.294935+00:00 [notice] <0.230.0> Logging: configured log handlers are now ACTIVE 2026-03-13 12:25:14.484221+00:00 [info] <0.230.0> ra: starting system quorum_queues 2026-03-13 12:25:14.484394+00:00 [info] <0.230.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/rabbit@np0000158692/quorum/rabbit@np0000158692 2026-03-13 12:25:14.537338+00:00 [info] <0.262.0> ra system 'quorum_queues' running pre init for 0 registered servers 2026-03-13 12:25:14.545550+00:00 [info] <0.263.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered 2026-03-13 12:25:14.556910+00:00 [notice] <0.268.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables 2026-03-13 12:25:14.562912+00:00 [info] <0.230.0> ra: starting system coordination 2026-03-13 12:25:14.562944+00:00 [info] <0.230.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/rabbit@np0000158692/coordination/rabbit@np0000158692 2026-03-13 12:25:14.564190+00:00 [info] <0.275.0> ra system 'coordination' running pre init for 0 registered servers 2026-03-13 12:25:14.564893+00:00 [info] <0.276.0> ra: meta data store initialised for system coordination. 0 record(s) recovered 2026-03-13 12:25:14.565003+00:00 [notice] <0.281.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables 2026-03-13 12:25:14.568043+00:00 [info] <0.230.0> 2026-03-13 12:25:14.568043+00:00 [info] <0.230.0> Starting RabbitMQ 3.12.1 on Erlang 25.3.2.8 [jit] 2026-03-13 12:25:14.568043+00:00 [info] <0.230.0> Copyright (c) 2007-2023 VMware, Inc. or its affiliates. 2026-03-13 12:25:14.568043+00:00 [info] <0.230.0> Licensed under the MPL 2.0. Website: https://rabbitmq.com 2026-03-13 12:25:14.569078+00:00 [info] <0.230.0> 2026-03-13 12:25:14.569078+00:00 [info] <0.230.0> node : rabbit@np0000158692 2026-03-13 12:25:14.569078+00:00 [info] <0.230.0> home dir : /var/lib/rabbitmq 2026-03-13 12:25:14.569078+00:00 [info] <0.230.0> config file(s) : (none) 2026-03-13 12:25:14.569078+00:00 [info] <0.230.0> cookie hash : iCs9WOpU0XMa7nrTzJB8ag== 2026-03-13 12:25:14.569078+00:00 [info] <0.230.0> log(s) : /var/log/rabbitmq/rabbit@np0000158692.log 2026-03-13 12:25:14.569078+00:00 [info] <0.230.0> : 2026-03-13 12:25:14.569078+00:00 [info] <0.230.0> data dir : /var/lib/rabbitmq/mnesia/rabbit@np0000158692 2026-03-13 12:25:16.818480+00:00 [info] <0.230.0> Running boot step pre_boot defined by app rabbit 2026-03-13 12:25:16.818572+00:00 [info] <0.230.0> Running boot step rabbit_global_counters defined by app rabbit 2026-03-13 12:25:16.818854+00:00 [info] <0.230.0> Running boot step rabbit_osiris_metrics defined by app rabbit 2026-03-13 12:25:16.818944+00:00 [info] <0.230.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-03-13 12:25:16.820455+00:00 [info] <0.230.0> Running boot step rabbit_alarm defined by app rabbit 2026-03-13 12:25:16.830264+00:00 [info] <0.299.0> Memory high watermark set to 25720 MiB (26969817088 bytes) of 64301 MiB (67424542720 bytes) total 2026-03-13 12:25:16.835993+00:00 [info] <0.301.0> Enabling free disk space monitoring (disk free space: 283779870720, total memory: 67424542720) 2026-03-13 12:25:16.836027+00:00 [info] <0.301.0> Disk free limit set to 50MB 2026-03-13 12:25:16.839414+00:00 [info] <0.230.0> Running boot step code_server_cache defined by app rabbit 2026-03-13 12:25:16.839481+00:00 [info] <0.230.0> Running boot step file_handle_cache defined by app rabbit 2026-03-13 12:25:16.839641+00:00 [info] <0.304.0> Limiting to approx 65439 file handles (58893 sockets) 2026-03-13 12:25:16.839734+00:00 [info] <0.305.0> FHC read buffering: OFF 2026-03-13 12:25:16.839761+00:00 [info] <0.305.0> FHC write buffering: ON 2026-03-13 12:25:16.840208+00:00 [info] <0.230.0> Running boot step worker_pool defined by app rabbit 2026-03-13 12:25:16.840256+00:00 [info] <0.283.0> Will use 16 processes for default worker pool 2026-03-13 12:25:16.840284+00:00 [info] <0.283.0> Starting worker pool 'worker_pool' with 16 processes in it 2026-03-13 12:25:16.840798+00:00 [info] <0.230.0> Running boot step database defined by app rabbit 2026-03-13 12:25:16.841308+00:00 [info] <0.230.0> Node database directory at /var/lib/rabbitmq/mnesia/rabbit@np0000158692 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-03-13 12:25:16.841367+00:00 [info] <0.230.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-03-13 12:25:16.841424+00:00 [info] <0.230.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-13 12:25:16.841536+00:00 [info] <0.230.0> All discovered existing cluster peers: 2026-03-13 12:25:16.841565+00:00 [info] <0.230.0> Discovered no peer nodes to cluster with. Some discovery backends can filter nodes out based on a readiness criteria. Enabling debug logging might help troubleshoot. 2026-03-13 12:25:16.843127+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped 2026-03-13 12:25:16.934298+00:00 [info] <0.230.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-13 12:25:16.934411+00:00 [info] <0.230.0> Successfully synced tables from a peer 2026-03-13 12:25:16.934757+00:00 [notice] <0.284.0> Feature flags: attempt to enable `stream_sac_coordinator_unblock_group`... 2026-03-13 12:25:16.966753+00:00 [notice] <0.284.0> Feature flags: `stream_sac_coordinator_unblock_group` enabled 2026-03-13 12:25:16.966946+00:00 [notice] <0.284.0> Feature flags: attempt to enable `restart_streams`... 2026-03-13 12:25:16.998326+00:00 [notice] <0.284.0> Feature flags: `restart_streams` enabled 2026-03-13 12:25:16.998611+00:00 [info] <0.230.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-13 12:25:16.998710+00:00 [info] <0.230.0> Successfully synced tables from a peer 2026-03-13 12:25:17.006840+00:00 [info] <0.230.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-13 12:25:17.007093+00:00 [info] <0.230.0> Successfully synced tables from a peer 2026-03-13 12:25:17.007214+00:00 [info] <0.230.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping registration. 2026-03-13 12:25:17.007355+00:00 [info] <0.230.0> Will try to unlock with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-13 12:25:17.007800+00:00 [info] <0.230.0> Running boot step tracking_metadata_store defined by app rabbit 2026-03-13 12:25:17.007970+00:00 [info] <0.494.0> Setting up a table for connection tracking on this node: tracked_connection 2026-03-13 12:25:17.008107+00:00 [info] <0.494.0> Setting up a table for per-vhost connection counting on this node: tracked_connection_per_vhost 2026-03-13 12:25:17.008275+00:00 [info] <0.494.0> Setting up a table for per-user connection counting on this node: tracked_connection_per_user 2026-03-13 12:25:17.008450+00:00 [info] <0.494.0> Setting up a table for channel tracking on this node: tracked_channel 2026-03-13 12:25:17.008662+00:00 [info] <0.494.0> Setting up a table for channel tracking on this node: tracked_channel_per_user 2026-03-13 12:25:17.008896+00:00 [info] <0.230.0> Running boot step networking_metadata_store defined by app rabbit 2026-03-13 12:25:17.009056+00:00 [info] <0.230.0> Running boot step feature_flags defined by app rabbit 2026-03-13 12:25:17.009542+00:00 [info] <0.230.0> Running boot step codec_correctness_check defined by app rabbit 2026-03-13 12:25:17.009632+00:00 [info] <0.230.0> Running boot step external_infrastructure defined by app rabbit 2026-03-13 12:25:17.009707+00:00 [info] <0.230.0> Running boot step rabbit_event defined by app rabbit 2026-03-13 12:25:17.009969+00:00 [info] <0.230.0> Running boot step rabbit_registry defined by app rabbit 2026-03-13 12:25:17.010099+00:00 [info] <0.230.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-03-13 12:25:17.010261+00:00 [info] <0.230.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-03-13 12:25:17.010430+00:00 [info] <0.230.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-03-13 12:25:17.010573+00:00 [info] <0.230.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-03-13 12:25:17.010709+00:00 [info] <0.230.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-03-13 12:25:17.010810+00:00 [info] <0.230.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-03-13 12:25:17.010943+00:00 [info] <0.230.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-03-13 12:25:17.011023+00:00 [info] <0.230.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-03-13 12:25:17.011096+00:00 [info] <0.230.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-03-13 12:25:17.011159+00:00 [info] <0.230.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-03-13 12:25:17.011232+00:00 [info] <0.230.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-03-13 12:25:17.011323+00:00 [info] <0.230.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-03-13 12:25:17.011407+00:00 [info] <0.230.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-03-13 12:25:17.011496+00:00 [info] <0.230.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-03-13 12:25:17.011624+00:00 [info] <0.230.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-03-13 12:25:17.011775+00:00 [info] <0.230.0> Running boot step kernel_ready defined by app rabbit 2026-03-13 12:25:17.011831+00:00 [info] <0.230.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-03-13 12:25:17.012017+00:00 [info] <0.230.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-03-13 12:25:17.013218+00:00 [info] <0.502.0> epmd monitor knows us, inter-node communication (distribution) port: 25672 2026-03-13 12:25:17.013330+00:00 [info] <0.230.0> Running boot step guid_generator defined by app rabbit 2026-03-13 12:25:17.015810+00:00 [info] <0.230.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-03-13 12:25:17.016065+00:00 [info] <0.506.0> Starting rabbit_node_monitor 2026-03-13 12:25:17.016236+00:00 [info] <0.230.0> Running boot step delegate_sup defined by app rabbit 2026-03-13 12:25:17.017416+00:00 [info] <0.230.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-03-13 12:25:17.017787+00:00 [info] <0.230.0> Running boot step rabbit_fifo_dlx_sup defined by app rabbit 2026-03-13 12:25:17.017907+00:00 [info] <0.230.0> Running boot step core_initialized defined by app rabbit 2026-03-13 12:25:17.017975+00:00 [info] <0.230.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit 2026-03-13 12:25:17.018060+00:00 [info] <0.230.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-03-13 12:25:17.018152+00:00 [info] <0.230.0> Running boot step rabbit_definitions_hashing defined by app rabbit 2026-03-13 12:25:17.018215+00:00 [info] <0.230.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-03-13 12:25:17.018510+00:00 [info] <0.230.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-03-13 12:25:17.018951+00:00 [info] <0.230.0> Running boot step rabbit_policies defined by app rabbit 2026-03-13 12:25:17.019445+00:00 [info] <0.230.0> Running boot step rabbit_policy defined by app rabbit 2026-03-13 12:25:17.019512+00:00 [info] <0.230.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-03-13 12:25:17.019640+00:00 [info] <0.230.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit 2026-03-13 12:25:17.019748+00:00 [info] <0.230.0> Running boot step rabbit_stream_coordinator defined by app rabbit 2026-03-13 12:25:17.019934+00:00 [info] <0.230.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-03-13 12:25:17.020041+00:00 [info] <0.230.0> Running boot step recovery defined by app rabbit 2026-03-13 12:25:17.021098+00:00 [info] <0.230.0> Running boot step empty_db_check defined by app rabbit 2026-03-13 12:25:17.021153+00:00 [info] <0.230.0> Will seed default virtual host and user... 2026-03-13 12:25:17.021308+00:00 [info] <0.230.0> Adding vhost '/' (description: 'Default virtual host', tags: []) 2026-03-13 12:25:17.023889+00:00 [info] <0.230.0> Inserted a virtual host record {vhost,<<"/">>,[], 2026-03-13 12:25:17.023889+00:00 [info] <0.230.0> #{description => 2026-03-13 12:25:17.023889+00:00 [info] <0.230.0> <<"Default virtual host">>, 2026-03-13 12:25:17.023889+00:00 [info] <0.230.0> tags => []}} 2026-03-13 12:25:17.038371+00:00 [info] <0.547.0> Making sure data directory '/var/lib/rabbitmq/mnesia/rabbit@np0000158692/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-03-13 12:25:17.040237+00:00 [info] <0.547.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048' 2026-03-13 12:25:17.046037+00:00 [info] <0.547.0> Starting message stores for vhost '/' 2026-03-13 12:25:17.046249+00:00 [info] <0.557.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-03-13 12:25:17.047930+00:00 [info] <0.547.0> Started message store of type transient for vhost '/' 2026-03-13 12:25:17.048121+00:00 [info] <0.561.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-03-13 12:25:17.048882+00:00 [warning] <0.561.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-03-13 12:25:17.049932+00:00 [info] <0.547.0> Started message store of type persistent for vhost '/' 2026-03-13 12:25:17.050090+00:00 [info] <0.547.0> Recovering 0 queues of type rabbit_classic_queue took 9ms 2026-03-13 12:25:17.050175+00:00 [info] <0.547.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms 2026-03-13 12:25:17.050233+00:00 [info] <0.547.0> Recovering 0 queues of type rabbit_stream_queue took 0ms 2026-03-13 12:25:17.054129+00:00 [info] <0.230.0> Created user 'guest' 2026-03-13 12:25:17.055937+00:00 [info] <0.230.0> Successfully set user tags for user 'guest' to [administrator] 2026-03-13 12:25:17.058012+00:00 [info] <0.230.0> Successfully set permissions for user 'guest' in virtual host '/' to '.*', '.*', '.*' 2026-03-13 12:25:17.058132+00:00 [info] <0.230.0> Running boot step rabbit_observer_cli defined by app rabbit 2026-03-13 12:25:17.058212+00:00 [info] <0.230.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-03-13 12:25:17.058288+00:00 [info] <0.230.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-03-13 12:25:17.058484+00:00 [info] <0.230.0> Running boot step background_gc defined by app rabbit 2026-03-13 12:25:17.058644+00:00 [info] <0.230.0> Running boot step routing_ready defined by app rabbit 2026-03-13 12:25:17.058690+00:00 [info] <0.230.0> Running boot step pre_flight defined by app rabbit 2026-03-13 12:25:17.058753+00:00 [info] <0.230.0> Running boot step notify_cluster defined by app rabbit 2026-03-13 12:25:17.058833+00:00 [info] <0.230.0> Running boot step networking defined by app rabbit 2026-03-13 12:25:17.058902+00:00 [info] <0.230.0> Running boot step definition_import_worker_pool defined by app rabbit 2026-03-13 12:25:17.058984+00:00 [info] <0.283.0> Starting worker pool 'definition_import_pool' with 16 processes in it 2026-03-13 12:25:17.059791+00:00 [info] <0.230.0> Running boot step cluster_name defined by app rabbit 2026-03-13 12:25:17.059870+00:00 [info] <0.230.0> Initialising internal cluster ID to 'rabbitmq-cluster-id-8pa5d72nfakS5trBQLW_KA' 2026-03-13 12:25:17.062182+00:00 [info] <0.230.0> Running boot step direct_client defined by app rabbit 2026-03-13 12:25:17.062306+00:00 [info] <0.230.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit 2026-03-13 12:25:17.062361+00:00 [info] <0.230.0> Creating table rabbit_node_maintenance_states for maintenance mode status 2026-03-13 12:25:17.065868+00:00 [info] <0.611.0> Resetting node maintenance status 2026-03-13 12:25:17.066087+00:00 [info] <0.611.0> Ready to start client connection listeners 2026-03-13 12:25:17.068228+00:00 [info] <0.629.0> started TCP listener on [::]:5672 2026-03-13 12:25:17.138140+00:00 [info] <0.611.0> Server startup complete; 0 plugins started. 2026-03-13 12:25:20.018780+00:00 [info] <0.641.0> Created user 'stackrabbit' 2026-03-13 12:25:20.656017+00:00 [info] <0.648.0> Successfully set permissions for user 'stackrabbit' in virtual host '/' to '.*', '.*', '.*' 2026-03-13 12:25:21.328554+00:00 [info] <0.655.0> Successfully changed password for user 'stackrabbit' 2026-03-13 12:25:22.013789+00:00 [info] <0.662.0> Deleted user 'guest' 2026-03-13 12:25:22.014069+00:00 [info] <0.664.0> Closing all connections from user 'guest' because it's being deleted 2026-03-13 12:28:25.749991+00:00 [info] <0.706.0> Adding vhost 'nova_cell1' (description: '', tags: []) 2026-03-13 12:28:25.754109+00:00 [info] <0.706.0> Inserted a virtual host record {vhost,<<"nova_cell1">>,[], 2026-03-13 12:28:25.754109+00:00 [info] <0.706.0> #{description => <<>>,tags => []}} 2026-03-13 12:28:25.777559+00:00 [info] <0.718.0> Making sure data directory '/var/lib/rabbitmq/mnesia/rabbit@np0000158692/msg_stores/vhosts/6RTRUNKEABC4BKCG2P5ONFZRJ' for vhost 'nova_cell1' exists 2026-03-13 12:28:25.778717+00:00 [info] <0.718.0> Setting segment_entry_count for vhost 'nova_cell1' with 0 queues to '2048' 2026-03-13 12:28:25.786739+00:00 [info] <0.718.0> Starting message stores for vhost 'nova_cell1' 2026-03-13 12:28:25.786981+00:00 [info] <0.727.0> Message store "6RTRUNKEABC4BKCG2P5ONFZRJ/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-03-13 12:28:25.788653+00:00 [info] <0.718.0> Started message store of type transient for vhost 'nova_cell1' 2026-03-13 12:28:25.788822+00:00 [info] <0.731.0> Message store "6RTRUNKEABC4BKCG2P5ONFZRJ/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-03-13 12:28:25.789727+00:00 [warning] <0.731.0> Message store "6RTRUNKEABC4BKCG2P5ONFZRJ/msg_store_persistent": rebuilding indices from scratch 2026-03-13 12:28:25.790886+00:00 [info] <0.718.0> Started message store of type persistent for vhost 'nova_cell1' 2026-03-13 12:28:25.791024+00:00 [info] <0.718.0> Recovering 0 queues of type rabbit_classic_queue took 11ms 2026-03-13 12:28:25.791069+00:00 [info] <0.718.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms 2026-03-13 12:28:25.791156+00:00 [info] <0.718.0> Recovering 0 queues of type rabbit_stream_queue took 0ms 2026-03-13 12:28:26.478949+00:00 [info] <0.762.0> Successfully set permissions for user 'stackrabbit' in virtual host 'nova_cell1' to '.*', '.*', '.*'