Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

The joining node kick out the donor node off the cluster during SST/IST #623

Open
houndegnonm opened this issue Aug 12, 2022 · 0 comments
Open

The joining node kick out the donor node off the cluster during SST/IST #623

houndegnonm opened this issue Aug 12, 2022 · 0 comments

Comments

@houndegnonm
Copy link

houndegnonm commented Aug 12, 2022 •
edited
Loading

I have 3 Percona Galera XtraDB Cluster with 3 nodes
pexgal001-dev3
pexgal002-dev3
pexgal003-dev3

version of the server

root@pexgal001-dev3:/var/lib/mysql-pexgal001/logs# dpkg --list | grep -i percona
ii  percona-xtrabackup-24                 2.4.26-1.focal                    amd64        Open source backup tool for InnoDB and XtraDB
ii  percona-xtradb-cluster-client-5.7     5.7.31-31.45-3.focal              amd64        Percona XtraDB Cluster database client binaries
ii  percona-xtradb-cluster-common-5.7     5.7.31-31.45-3.focal              amd64        Percona XtraDB Cluster database common files (e.g. /etc/mysql/my.cnf)
ii  percona-xtradb-cluster-server-5.7     5.7.31-31.45-3.focal              amd64        Percona XtraDB Cluster database server binaries

When trying to shutdown a specific node by example pexgal001-dev3, pexgal002/3 respectively detect the node is out of the cluster and behave as designed, but when pexgal001-dev3 is now up again this caused a split brain situation between the donor (pexgal003-dev3) and the joining node (pexgal001-dev3) leaving only 1 node up and running in the cluster (pexgal002-dev3)

Here is the full log of pexgal002-dev3 and pexgal003-dev3 (donor) when the joining pexgal001-dev3 node is down and then up.

###### pexgal002-dev3 error log ###### 
######                          ###### 
######                          ###### 

###### When stopping pexgal001-dev3
2022-08-12T17:39:05.458404Z 0 [Note] WSREP: declaring cfa5fea8 at tcp://192.168.170.143:4567 stable
2022-08-12T17:39:05.458495Z 0 [Note] WSREP: forgetting f5d705fe (tcp://192.168.170.141:4567)
2022-08-12T17:39:05.459191Z 0 [Note] WSREP: Node 67c46602 state primary
2022-08-12T17:39:05.459468Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,67c46602,42)
memb {
        67c46602,0
        cfa5fea8,0
        }
joined {
        }
left {
        }
partitioned {
        f5d705fe,0
        }
)
2022-08-12T17:39:05.459493Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:39:05.460743Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
2022-08-12T17:39:05.460840Z 0 [Note] WSREP: forgetting f5d705fe (tcp://192.168.170.141:4567)
2022-08-12T17:39:05.461012Z 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a9691181-1a65-11ed-b29a-efd09340cd08
2022-08-12T17:39:05.463488Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a9691181-1a65-11ed-b29a-efd09340cd08
2022-08-12T17:39:05.463818Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: a9691181-1a65-11ed-b29a-efd09340cd08 from 0 (pexgal002-dev3)
2022-08-12T17:39:05.463855Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: a9691181-1a65-11ed-b29a-efd09340cd08 from 1 (pexgal003-dev3)
2022-08-12T17:39:05.463865Z 0 [Note] WSREP: Quorum results:
        version    = 6,
        component  = PRIMARY,
        conf_id    = 4,
        members    = 2/2 (primary/total),
        act_id     = 2249383,
        last_appl. = 2249281,
        protocols  = 0/9/3 (gcs/repl/appl),
        group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:39:05.463897Z 0 [Note] WSREP: Flow-control interval: [2896, 2896]
2022-08-12T17:39:05.464016Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:39:05.464232Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:39:05.464327Z 4 [Note] WSREP: New cluster view: global state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383, view# 5: Primary, number of nodes: 2, my index: 0, protocol version 3
2022-08-12T17:39:05.464386Z 4 [Note] WSREP: Setting wsrep_ready to true
2022-08-12T17:39:05.464439Z 4 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 1 -> 1) (Increment: 3 -> 2)
2022-08-12T17:39:05.464518Z 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:39:05.464822Z 4 [Note] WSREP: Assign initial position for certification: 2249383, protocol version: 4
2022-08-12T17:39:05.464983Z 0 [Note] WSREP: Service thread queue flushed.
2022-08-12T17:39:10.472899Z 0 [Note] WSREP:  cleaning up f5d705fe (tcp://192.168.170.141:4567)


###### When starting pexgal001-dev3

2022-08-12T17:42:03.229785Z 0 [Note] WSREP: (67c46602, 'tcp://0.0.0.0:4567') connection established to 135e2e5d tcp://192.168.170.141:4567
2022-08-12T17:42:03.230100Z 0 [Note] WSREP: (67c46602, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2022-08-12T17:42:03.487024Z 0 [Note] WSREP: declaring 135e2e5d at tcp://192.168.170.141:4567 stable
2022-08-12T17:42:03.487143Z 0 [Note] WSREP: declaring cfa5fea8 at tcp://192.168.170.143:4567 stable
2022-08-12T17:42:03.487575Z 0 [Note] WSREP: Node 67c46602 state primary
2022-08-12T17:42:03.487967Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,135e2e5d,43)
memb {
	135e2e5d,0
	67c46602,0
	cfa5fea8,0
	}
joined {
	}
left {
	}
partitioned {
	}
)
2022-08-12T17:42:03.487989Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:42:03.489459Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3
2022-08-12T17:42:03.489576Z 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2022-08-12T17:42:03.730225Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff
2022-08-12T17:42:03.730707Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 0 (pexgal001-dev3)
2022-08-12T17:42:03.730778Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 1 (pexgal002-dev3)
2022-08-12T17:42:03.730857Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 2 (pexgal003-dev3)
2022-08-12T17:42:03.730928Z 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 5,
	members    = 2/3 (primary/total),
	act_id     = 2249393,
	last_appl. = 2249281,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:42:03.730962Z 0 [Note] WSREP: Flow-control interval: [3547, 3547]
2022-08-12T17:42:03.731108Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:03.731147Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:03.731204Z 4 [Note] WSREP: New cluster view: global state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249393, view# 6: Primary, number of nodes: 3, my index: 1, protocol version 3
2022-08-12T17:42:03.731260Z 4 [Note] WSREP: Setting wsrep_ready to true
2022-08-12T17:42:03.731296Z 4 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 1 -> 2) (Increment: 2 -> 3)
2022-08-12T17:42:03.731325Z 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:42:03.731408Z 4 [Note] WSREP: Assign initial position for certification: 2249393, protocol version: 4
2022-08-12T17:42:03.731511Z 0 [Note] WSREP: Service thread queue flushed.
2022-08-12T17:42:06.278837Z 0 [Note] WSREP: Member 0.0 (pexgal001-dev3) requested state transfer from '*any*'. Selected 2.0 (pexgal003-dev3)(SYNCED) as donor.
2022-08-12T17:42:06.516975Z 0 [Note] WSREP: (67c46602, 'tcp://0.0.0.0:4567') turning message relay requesting off
2022-08-12T17:42:08.369352Z 0 [Note] WSREP: 2.0 (pexgal003-dev3): State transfer to 0.0 (pexgal001-dev3) complete.
2022-08-12T17:42:08.369881Z 0 [Note] WSREP: Member 2.0 (pexgal003-dev3) synced with group.
2022-08-12T17:42:16.284726Z 0 [Note] WSREP: declaring 135e2e5d at tcp://192.168.170.141:4567 stable
2022-08-12T17:42:16.284905Z 0 [Note] WSREP: forgetting cfa5fea8 (tcp://192.168.170.143:4567)
2022-08-12T17:42:16.285713Z 0 [Note] WSREP: Node 135e2e5d state primary
2022-08-12T17:42:16.288477Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,135e2e5d,44)
memb {
	135e2e5d,0
	67c46602,0
	}
joined {
	}
left {
	}
partitioned {
	cfa5fea8,0
	}
)
2022-08-12T17:42:16.288561Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:42:16.289634Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2022-08-12T17:42:16.289695Z 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2022-08-12T17:42:16.289737Z 0 [Note] WSREP: forgetting cfa5fea8 (tcp://192.168.170.143:4567)
2022-08-12T17:42:16.290193Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 1b2706f6-1a66-11ed-9fae-7fc396c0da36
2022-08-12T17:42:16.290483Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b2706f6-1a66-11ed-9fae-7fc396c0da36 from 0 (pexgal001-dev3)
2022-08-12T17:42:16.290568Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b2706f6-1a66-11ed-9fae-7fc396c0da36 from 1 (pexgal002-dev3)
2022-08-12T17:42:16.290600Z 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 6,
	members    = 1/2 (primary/total),
	act_id     = 2249393,
	last_appl. = 2249281,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:42:16.290644Z 0 [Note] WSREP: Flow-control interval: [2896, 2896]
2022-08-12T17:42:16.290712Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:16.290774Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:16.290804Z 4 [Note] WSREP: New cluster view: global state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249393, view# 7: Primary, number of nodes: 2, my index: 1, protocol version 3
2022-08-12T17:42:16.290823Z 4 [Note] WSREP: Setting wsrep_ready to true
2022-08-12T17:42:16.290841Z 4 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 2 -> 2) (Increment: 3 -> 2)
2022-08-12T17:42:16.290892Z 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:42:16.290950Z 4 [Note] WSREP: Assign initial position for certification: 2249393, protocol version: 4
2022-08-12T17:42:16.291011Z 0 [Note] WSREP: Service thread queue flushed.
2022-08-12T17:42:21.521764Z 0 [Note] WSREP:  cleaning up cfa5fea8 (tcp://192.168.170.143:4567)

###### pexgal003-dev3 error log ###### 
######                          ###### 
######                          ###### 

###### When stopping pexgal001-dev3

2022-08-12T17:39:05.458758Z 0 [Note] WSREP: declaring 67c46602 at tcp://192.168.170.142:4567 stable
2022-08-12T17:39:05.458876Z 0 [Note] WSREP: forgetting f5d705fe (tcp://192.168.170.141:4567)
2022-08-12T17:39:05.459240Z 0 [Note] WSREP: Node 67c46602 state primary
2022-08-12T17:39:05.461236Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,67c46602,42)
memb {
	67c46602,0
	cfa5fea8,0
	}
joined {
	}
left {
	}
partitioned {
	f5d705fe,0
	}
)
2022-08-12T17:39:05.461260Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:39:05.463141Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2022-08-12T17:39:05.463163Z 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2022-08-12T17:39:05.463179Z 0 [Note] WSREP: forgetting f5d705fe (tcp://192.168.170.141:4567)
2022-08-12T17:39:05.463683Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a9691181-1a65-11ed-b29a-efd09340cd08
2022-08-12T17:39:05.464056Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: a9691181-1a65-11ed-b29a-efd09340cd08 from 0 (pexgal002-dev3)
2022-08-12T17:39:05.464079Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: a9691181-1a65-11ed-b29a-efd09340cd08 from 1 (pexgal003-dev3)
2022-08-12T17:39:05.464090Z 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 4,
	members    = 2/2 (primary/total),
	act_id     = 2249383,
	last_appl. = 2249281,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:39:05.464098Z 0 [Note] WSREP: Flow-control interval: [2896, 2896]
2022-08-12T17:39:05.464140Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:39:05.464147Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:39:05.464154Z 4 [Note] WSREP: New cluster view: global state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383, view# 5: Primary, number of nodes: 2, my index: 1, protocol version 3
2022-08-12T17:39:05.464166Z 4 [Note] WSREP: Setting wsrep_ready to true
2022-08-12T17:39:05.464171Z 4 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 2 -> 2) (Increment: 3 -> 2)
2022-08-12T17:39:05.464203Z 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:39:05.464490Z 4 [Note] WSREP: Assign initial position for certification: 2249383, protocol version: 4
2022-08-12T17:39:05.464604Z 0 [Note] WSREP: Service thread queue flushed.
2022-08-12T17:39:10.899384Z 0 [Note] WSREP:  cleaning up f5d705fe (tcp://192.168.170.141:4567)

###### When starting pexgal001-dev3

2022-08-12T17:42:03.229836Z 0 [Note] WSREP: (cfa5fea8, 'tcp://0.0.0.0:4567') connection established to 135e2e5d tcp://192.168.170.141:4567
2022-08-12T17:42:03.230197Z 0 [Note] WSREP: (cfa5fea8, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2022-08-12T17:42:03.487025Z 0 [Note] WSREP: declaring 135e2e5d at tcp://192.168.170.141:4567 stable
2022-08-12T17:42:03.487196Z 0 [Note] WSREP: declaring 67c46602 at tcp://192.168.170.142:4567 stable
2022-08-12T17:42:03.487562Z 0 [Note] WSREP: Node 67c46602 state primary
2022-08-12T17:42:03.487971Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,135e2e5d,43)
memb {
	135e2e5d,0
	67c46602,0
	cfa5fea8,0
	}
joined {
	}
left {
	}
partitioned {
	}
)
2022-08-12T17:42:03.488022Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:42:03.489881Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2022-08-12T17:42:03.489904Z 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2022-08-12T17:42:03.730260Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff
2022-08-12T17:42:03.730846Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 0 (pexgal001-dev3)
2022-08-12T17:42:03.730862Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 1 (pexgal002-dev3)
2022-08-12T17:42:03.730867Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 2 (pexgal003-dev3)
2022-08-12T17:42:03.730872Z 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 5,
	members    = 2/3 (primary/total),
	act_id     = 2249393,
	last_appl. = 2249281,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:42:03.730879Z 0 [Note] WSREP: Flow-control interval: [3547, 3547]
2022-08-12T17:42:03.730974Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:03.731015Z 4 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:03.731033Z 4 [Note] WSREP: New cluster view: global state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249393, view# 6: Primary, number of nodes: 3, my index: 2, protocol version 3
2022-08-12T17:42:03.731048Z 4 [Note] WSREP: Setting wsrep_ready to true
2022-08-12T17:42:03.731072Z 4 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 2 -> 3) (Increment: 2 -> 3)
2022-08-12T17:42:03.731092Z 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:42:03.731161Z 4 [Note] WSREP: Assign initial position for certification: 2249393, protocol version: 4
2022-08-12T17:42:03.731233Z 0 [Note] WSREP: Service thread queue flushed.
2022-08-12T17:42:06.278904Z 0 [Note] WSREP: Member 0.0 (pexgal001-dev3) requested state transfer from '*any*'. Selected 2.0 (pexgal003-dev3)(SYNCED) as donor.
2022-08-12T17:42:06.278953Z 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 2249393)
2022-08-12T17:42:06.279191Z 4 [Note] WSREP: IST request: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383-2249393|tcp://192.168.170.141:4568
2022-08-12T17:42:06.279208Z 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:42:06.279410Z 0 [Note] WSREP: Initiating SST/IST transfer on DONOR side (wsrep_sst_xtrabackup-v2 --role 'donor' --address '192.168.170.141:4444/xtrabackup_sst//1' --socket '/var/lib/mysql-pexgal003/run/mysql.sock' --datadir '/var/lib/mysql-pexgal003/myisam/data/' --defaults-file '/var/lib/mysql-pexgal003/my.cnf-master' --defaults-group-suffix '' --mysqld-version '5.7.31-34-57'  --binlog '/var/lib/mysql-pexgal003/binlogs/pexgal003-bin' --gtid '7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383'  --bypass)
2022-08-12T17:42:06.279989Z 4 [Note] WSREP: DONOR thread signaled with 0
2022-08-12T17:42:06.280342Z 4 [ERROR] WSREP: context: unable to load ssl3 md5 routines
2022-08-12T17:42:06.280355Z 4 [Note] WSREP: applier thread exiting (code:8)
2022-08-12T17:42:06.280369Z 4 [Note] WSREP: Starting Shutdown
2022-08-12T17:42:06.280476Z 0 [Note] WSREP: Received shutdown signal. Will sleep for 10 secs before initiating shutdown. pxc_maint_mode switched to SHUTDOWN
2022-08-12T17:42:06.440009Z 0 [Note] WSREP: (cfa5fea8, 'tcp://0.0.0.0:4567') turning message relay requesting off
	2022-08-12T17:42:08.168411Z WSREP_SST: [INFO] Streaming with xbstream
	2022-08-12T17:42:08.279961Z WSREP_SST: [INFO] Bypassing SST. Can work it through IST
2022-08-12T17:42:08.369360Z 0 [Note] WSREP: 2.0 (pexgal003-dev3): State transfer to 0.0 (pexgal001-dev3) complete.
2022-08-12T17:42:08.369400Z 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 2249393)
2022-08-12T17:42:08.369872Z 0 [Note] WSREP: Member 2.0 (pexgal003-dev3) synced with group.
2022-08-12T17:42:08.369890Z 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2249393)
2022-08-12T17:42:16.282955Z 0 [Note] WSREP: Stop replication
2022-08-12T17:42:16.283053Z 0 [Note] WSREP: Closing send monitor...
2022-08-12T17:42:16.283079Z 0 [Note] WSREP: Closed send monitor.
2022-08-12T17:42:16.283132Z 0 [Note] WSREP: gcomm: terminating thread
2022-08-12T17:42:16.283184Z 0 [Note] WSREP: gcomm: joining thread
2022-08-12T17:42:16.283299Z 0 [Note] WSREP: gcomm: closing backend
2022-08-12T17:42:16.284403Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(NON_PRIM,135e2e5d,43)
memb {
	cfa5fea8,0
	}
joined {
	}
left {
	}
partitioned {
	135e2e5d,0
	67c46602,0
	}
)
2022-08-12T17:42:16.284617Z 0 [Note] WSREP: Current view of cluster as seen by this node
view ((empty))
2022-08-12T17:42:16.284902Z 0 [Note] WSREP: gcomm: closed
2022-08-12T17:42:16.284984Z 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
2022-08-12T17:42:16.285007Z 0 [Note] WSREP: Flow-control interval: [2048, 2048]
2022-08-12T17:42:16.285011Z 0 [Note] WSREP: Received NON-PRIMARY.
2022-08-12T17:42:16.285014Z 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 2249393)
2022-08-12T17:42:16.285020Z 0 [Note] WSREP: Received self-leave message.
2022-08-12T17:42:16.285024Z 0 [Note] WSREP: Flow-control interval: [0, 0]
2022-08-12T17:42:16.285026Z 0 [Note] WSREP: Received SELF-LEAVE. Closing connection.
2022-08-12T17:42:16.285028Z 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 2249393)
2022-08-12T17:42:16.285034Z 0 [Note] WSREP: RECV thread exiting 0: Success
2022-08-12T17:42:16.285070Z 0 [Note] WSREP: recv_thread() joined.
2022-08-12T17:42:16.285090Z 0 [Note] WSREP: Closing replication queue.
2022-08-12T17:42:16.285189Z 0 [Note] WSREP: Closing slave action queue.
2022-08-12T17:42:16.285213Z 0 [Note] WSREP: Waiting for active wsrep applier to exit

###### pexgal001-dev3 error log ###### 
######                          ###### 
######                          ###### 

###### When starting pexgal001-dev3
2022-08-12T17:42:03.205940Z 0 [Warning] The syntax '--log_warnings/-W' is deprecated and will be removed in a future release. Please use '--log_error_verbosity' instead.
2022-08-12T17:42:03.206113Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
2022-08-12T17:42:03.206122Z 0 [Warning] 'NO_AUTO_CREATE_USER' sql mode was not set.
2022-08-12T17:42:03.207915Z 0 [Warning] Insecure configuration for --secure-file-priv: Data directory is accessible through --secure-file-priv. Consider choosing a different directory.
2022-08-12T17:42:03.207923Z 0 [Warning] Insecure configuration for --secure-file-priv: Location is accessible to all OS users. Consider choosing a different directory.
2022-08-12T17:42:03.207995Z 0 [Note] /usr/sbin/mysqld (mysqld 5.7.31-34-57-log) starting as process 1979695 ...
2022-08-12T17:42:03.210869Z 0 [Note] WSREP: Setting wsrep_ready to false
2022-08-12T17:42:03.210882Z 0 [Note] WSREP: No pre-stored wsrep-start position found. Skipping position initialization.
2022-08-12T17:42:03.210885Z 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera3/libgalera_smm.so'
2022-08-12T17:42:03.211422Z 0 [Note] WSREP: wsrep_load(): Galera 3.45(ra60e019) by Codership Oy <[email protected]> loaded successfully.
2022-08-12T17:42:03.211472Z 0 [Note] WSREP: CRC-32C: using hardware acceleration.
2022-08-12T17:42:03.211734Z 0 [Note] WSREP: Found saved state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383, safe_to_bootstrap: 0
2022-08-12T17:42:03.211816Z 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4, offset: 1280
2022-08-12T17:42:03.211883Z 0 [Note] WSREP: GCache::RingBuffer initial scan...  0.0% (         0/5368709160 bytes) complete.
2022-08-12T17:42:03.212007Z 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (5368709160/5368709160 bytes) complete.
2022-08-12T17:42:03.212013Z 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 2249155-2249383
2022-08-12T17:42:03.212029Z 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...  0.0% (     0/147632 bytes) complete.
2022-08-12T17:42:03.212037Z 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (147632/147632 bytes) complete.
2022-08-12T17:42:03.212041Z 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): found 0/229 locked buffers
2022-08-12T17:42:03.212044Z 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): free space: 5368561488/5368709120
2022-08-12T17:42:03.213176Z 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql-pexgal001/myisam/data/; base_host = 192.168.170.141; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 10; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 4; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql-pexgal001/myisam/data/; gcache.freeze_purge_at_seqno = -1; gcache.keep_pages_count = 0; gcache.keep_pages_size = 512M; gcache.mem_size = 0; gcache.name = /var/lib/mysql-pexgal001/myisam/data//galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 5G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 2048; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.recovery = true; pc.version = 0; pc.wait_prim = true; pc.wait_prim_timeout = PT30S; pc.weight = 1; protonet.backend = asio; protonet.version = 0; repl.causal_read_timeout = PT30S; repl.commit_order = 3; repl.key_format = FLAT8; repl.max_ws_size = 2147483647; repl.proto_max = 9; socket.checksum = 2; socket.recv_buf_size = auto; socket.send_buf_size = auto;
2022-08-12T17:42:03.227503Z 0 [Note] WSREP: Assign initial position for certification: 2249383, protocol version: -1
2022-08-12T17:42:03.227542Z 0 [Note] WSREP: Preparing to initiate SST/IST
2022-08-12T17:42:03.227547Z 0 [Note] WSREP: Starting replication
2022-08-12T17:42:03.227554Z 0 [Note] WSREP: Setting initial position to 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383
2022-08-12T17:42:03.227717Z 0 [Note] WSREP: Using CRC-32C for message checksums.
2022-08-12T17:42:03.227819Z 0 [Note] WSREP: gcomm thread scheduling priority set to other:0
2022-08-12T17:42:03.227888Z 0 [Warning] WSREP: Fail to access the file (/var/lib/mysql-pexgal001/myisam/data//gvwstate.dat) error (No such file or directory). It is possible if node is booting for first time or re-booting after a graceful shutdown
2022-08-12T17:42:03.227894Z 0 [Note] WSREP: Restoring primary-component from disk failed. Either node is booting for first time or re-booting after a graceful shutdown
2022-08-12T17:42:03.228045Z 0 [Note] WSREP: GMCast version 0
2022-08-12T17:42:03.228168Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
2022-08-12T17:42:03.228174Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
2022-08-12T17:42:03.228379Z 0 [Note] WSREP: EVS version 0
2022-08-12T17:42:03.228450Z 0 [Note] WSREP: gcomm: connecting to group 'pexgal3', peer '192.168.170.141:,192.168.170.142:,192.168.170.143:'
2022-08-12T17:42:03.229050Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://192.168.170.141:4567
2022-08-12T17:42:03.230006Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') connection established to cfa5fea8 tcp://192.168.170.143:4567
2022-08-12T17:42:03.230071Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2022-08-12T17:42:03.230156Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') connection established to 67c46602 tcp://192.168.170.142:4567
2022-08-12T17:42:03.486959Z 0 [Note] WSREP: declaring 67c46602 at tcp://192.168.170.142:4567 stable
2022-08-12T17:42:03.486991Z 0 [Note] WSREP: declaring cfa5fea8 at tcp://192.168.170.143:4567 stable
2022-08-12T17:42:03.487535Z 0 [Note] WSREP: Node 67c46602 state primary
2022-08-12T17:42:03.487932Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,135e2e5d,43)
memb {
        135e2e5d,0
        67c46602,0
        cfa5fea8,0
        }
joined {
        }
left {
        }
partitioned {
        }
)
2022-08-12T17:42:03.487944Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:42:03.729040Z 0 [Note] WSREP: gcomm: connected
2022-08-12T17:42:03.729263Z 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2022-08-12T17:42:03.729308Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
2022-08-12T17:42:03.729393Z 0 [Note] WSREP: Waiting for SST/IST to complete.
2022-08-12T17:42:03.729511Z 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 13aab0e4-1a66-11ed-932b-ca9da6b99eff
2022-08-12T17:42:03.730198Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff
2022-08-12T17:42:03.730655Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 0 (pexgal001-dev3)
2022-08-12T17:42:03.730674Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 1 (pexgal002-dev3)
2022-08-12T17:42:03.730678Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13aab0e4-1a66-11ed-932b-ca9da6b99eff from 2 (pexgal003-dev3)
2022-08-12T17:42:03.730684Z 0 [Note] WSREP: Quorum results:
        version    = 6,
        component  = PRIMARY,
        conf_id    = 5,
        members    = 2/3 (primary/total),
        act_id     = 2249393,
        last_appl. = -1,
        protocols  = 0/9/3 (gcs/repl/appl),
        group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:42:03.730689Z 0 [Note] WSREP: Flow-control interval: [3547, 3547]
2022-08-12T17:42:03.730693Z 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2249393)
2022-08-12T17:42:03.730768Z 1 [Note] WSREP: State transfer required:
        Group state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249393
        Local state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383
2022-08-12T17:42:03.730800Z 1 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:03.730810Z 1 [Note] WSREP: REPL Protocols: 9 (4, 2)
2022-08-12T17:42:03.730820Z 1 [Note] WSREP: New cluster view: global state: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249393, view# 6: Primary, number of nodes: 3, my index: 0, protocol version 3
2022-08-12T17:42:03.730824Z 1 [Note] WSREP: Setting wsrep_ready to true
2022-08-12T17:42:03.730827Z 1 [Warning] WSREP: Gap in state sequence. Need state transfer.
2022-08-12T17:42:03.730829Z 1 [Note] WSREP: Setting wsrep_ready to false
2022-08-12T17:42:03.730918Z 0 [Note] WSREP: Initiating SST/IST transfer on JOINER side (wsrep_sst_xtrabackup-v2 --role 'joiner' --address '192.168.170.141' --datadir '/var/lib/mysql-pexgal001/myisam/data/' --defaults-file '/var/lib/mysql-pexgal001/my.cnf-master' --defaults-group-suffix '' --parent '1979695' --mysqld-version '5.7.31-34-57'  --binlog '/var/lib/mysql-pexgal001/binlogs/pexgal001-bin' )
        2022-08-12T17:42:05.544041Z WSREP_SST: [INFO] Streaming with xbstream
2022-08-12T17:42:06.230408Z 0 [Note] WSREP: (135e2e5d, 'tcp://0.0.0.0:4567') turning message relay requesting off
2022-08-12T17:42:06.276896Z 1 [Note] WSREP: Prepared SST/IST request: xtrabackup-v2|192.168.170.141:4444/xtrabackup_sst//1
2022-08-12T17:42:06.276922Z 1 [Note] WSREP: Auto Increment Offset/Increment re-align with cluster membership change (Offset: 1 -> 1) (Increment: 1 -> 3)
2022-08-12T17:42:06.276948Z 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2022-08-12T17:42:06.276970Z 1 [Note] WSREP: Assign initial position for certification: 2249393, protocol version: 4
2022-08-12T17:42:06.277008Z 0 [Note] WSREP: Service thread queue flushed.
2022-08-12T17:42:06.277023Z 1 [Note] WSREP: Check if state gap can be serviced using IST
2022-08-12T17:42:06.277090Z 1 [Note] WSREP: IST receiver addr using tcp://192.168.170.141:4568
2022-08-12T17:42:06.277244Z 1 [Note] WSREP: Prepared IST receiver, listening at: tcp://192.168.170.141:4568
2022-08-12T17:42:06.277254Z 1 [Note] WSREP: State gap can be likely serviced using IST. SST request though present would be void.
2022-08-12T17:42:06.278732Z 0 [Note] WSREP: Member 0.0 (pexgal001-dev3) requested state transfer from '*any*'. Selected 2.0 (pexgal003-dev3)(SYNCED) as donor.
2022-08-12T17:42:06.278742Z 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2249393)
2022-08-12T17:42:06.278758Z 1 [Note] WSREP: Requesting state transfer: success, donor: 2
2022-08-12T17:42:06.278782Z 1 [Note] WSREP: GCache history reset: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383 -> 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249393
2022-08-12T17:42:06.279261Z 1 [Note] WSREP: GCache DEBUG: RingBuffer::seqno_reset(): full reset
2022-08-12T17:42:08.369307Z 0 [Note] WSREP: 2.0 (pexgal003-dev3): State transfer to 0.0 (pexgal001-dev3) complete.
2022-08-12T17:42:08.369867Z 0 [Note] WSREP: Member 2.0 (pexgal003-dev3) synced with group.
        2022-08-12T17:42:08.496773Z WSREP_SST: [INFO] xtrabackup_ist received from donor: Running IST
        2022-08-12T17:42:08.498811Z WSREP_SST: [INFO] Galera co-ords from recovery: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383
2022-08-12T17:42:08.567634Z 0 [Note] WSREP: SST complete, seqno: 2249383
2022-08-12T17:42:08.571393Z 0 [Note] InnoDB: PUNCH HOLE support available
2022-08-12T17:42:08.571416Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2022-08-12T17:42:08.571419Z 0 [Note] InnoDB: Uses event mutexes
2022-08-12T17:42:08.571422Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
2022-08-12T17:42:08.571425Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2022-08-12T17:42:08.571428Z 0 [Note] InnoDB: Using Linux native AIO
2022-08-12T17:42:08.571858Z 0 [Note] InnoDB: Number of pools: 1
2022-08-12T17:42:08.571960Z 0 [Note] InnoDB: Using CPU crc32 instructions
2022-08-12T17:42:08.574376Z 0 [Note] InnoDB: Initializing buffer pool, total size = 4G, instances = 8, chunk size = 128M
2022-08-12T17:42:08.735191Z 0 [Note] InnoDB: Completed initialization of buffer pool
2022-08-12T17:42:08.792202Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2022-08-12T17:42:08.875641Z 0 [Note] InnoDB: Crash recovery did not find the parallel doublewrite buffer at /var/lib/mysql-pexgal001/innodb/data/xb_doublewrite
2022-08-12T17:42:08.877333Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
2022-08-12T17:42:09.031189Z 0 [Note] InnoDB: Created parallel doublewrite buffer at /var/lib/mysql-pexgal001/innodb/data/xb_doublewrite, size 31457280 bytes
2022-08-12T17:42:09.567759Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2022-08-12T17:42:09.567857Z 0 [Note] InnoDB: Setting file '/var/lib/mysql-pexgal001/innodb/data/ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2022-08-12T17:42:09.589231Z 0 [Note] InnoDB: File '/var/lib/mysql-pexgal001/innodb/data/ibtmp1' size is now 12 MB.
2022-08-12T17:42:09.590096Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
2022-08-12T17:42:09.590108Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
2022-08-12T17:42:09.593711Z 0 [Note] InnoDB: Waiting for purge to start
2022-08-12T17:42:09.644459Z 0 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.7.31-34 started; log sequence number 59199104884790
2022-08-12T17:42:09.644721Z 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql-pexgal001/innodb/data/ib_buffer_pool
2022-08-12T17:42:09.644860Z 0 [Note] Plugin 'FEDERATED' is disabled.
2022-08-12T17:42:09.742392Z 0 [Warning] Percona Server cannot operate under OpenSSL FIPS mode. Disabling FIPS.
2022-08-12T17:42:09.742421Z 0 [Note] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL support using them.
2022-08-12T17:42:09.742430Z 0 [Note] Skipping generation of SSL certificates as certificate files are present in data directory.
2022-08-12T17:42:09.742504Z 0 [Warning] Failed to set up SSL because of the following SSL library error: SSL_CTX_new failed
2022-08-12T17:42:09.742516Z 0 [Note] Skipping generation of RSA key pair as key files are present in data directory.
2022-08-12T17:42:09.742625Z 0 [Note] Server hostname (bind-address): '192.168.170.141'; port: 3306
2022-08-12T17:42:09.742635Z 0 [Note]   - '192.168.170.141' resolves to '192.168.170.141';
2022-08-12T17:42:09.742662Z 0 [Note] Server socket created on IP: '192.168.170.141'.
2022-08-12T17:42:09.861359Z 0 [Warning] 'user' entry '[email protected]' ignored in --skip-name-resolve mode.
2022-08-12T17:42:09.861401Z 0 [Warning] 'user' entry '@pexdb002c.grantstreet.com' ignored in --skip-name-resolve mode.
2022-08-12T17:42:09.876449Z 0 [Warning] 'proxies_priv' entry '@ [email protected]' ignored in --skip-name-resolve mode.
2022-08-12T17:42:10.545164Z 0 [Note] Event Scheduler: Loaded 0 events
2022-08-12T17:42:10.545342Z 0 [Note] WSREP: Signalling provider to continue on SST completion.
2022-08-12T17:42:10.545360Z 0 [Note] WSREP: Initialized wsrep sidno 2
2022-08-12T17:42:10.545378Z 0 [Note] WSREP: SST received: 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4:2249383
2022-08-12T17:42:10.545492Z 0 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.7.31-34-57-log'  socket: '/var/lib/mysql-pexgal001/run/mysql.sock'  port: 3306  Percona XtraDB Cluster (GPL), Release rel34, Revision d76a6e8, WSREP version 31.45, wsrep_31.45
2022-08-12T17:42:10.546120Z 1 [Note] WSREP: Receiving IST: 10 writesets, seqnos 2249383-2249393
2022-08-12T17:42:16.284805Z 0 [Note] WSREP: declaring 67c46602 at tcp://192.168.170.142:4567 stable
2022-08-12T17:42:16.284878Z 0 [Note] WSREP: forgetting cfa5fea8 (tcp://192.168.170.143:4567)
2022-08-12T17:42:16.285635Z 0 [Note] WSREP: Node 135e2e5d state primary
2022-08-12T17:42:16.285968Z 0 [Note] WSREP: Current view of cluster as seen by this node
view (view_id(PRIM,135e2e5d,44)
memb {
        135e2e5d,0
        67c46602,0
        }
joined {
        }
left {
        }
partitioned {
        cfa5fea8,0
        }
)
2022-08-12T17:42:16.285981Z 0 [Note] WSREP: Save the discovered primary-component to disk
2022-08-12T17:42:16.288212Z 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
2022-08-12T17:42:16.288276Z 0 [Note] WSREP: forgetting cfa5fea8 (tcp://192.168.170.143:4567)
2022-08-12T17:42:16.288312Z 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 1b2706f6-1a66-11ed-9fae-7fc396c0da36
2022-08-12T17:42:16.290035Z 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 1b2706f6-1a66-11ed-9fae-7fc396c0da36
2022-08-12T17:42:16.290434Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b2706f6-1a66-11ed-9fae-7fc396c0da36 from 0 (pexgal001-dev3)
2022-08-12T17:42:16.290453Z 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b2706f6-1a66-11ed-9fae-7fc396c0da36 from 1 (pexgal002-dev3)
2022-08-12T17:42:16.290459Z 0 [Note] WSREP: Quorum results:
        version    = 6,
        component  = PRIMARY,
        conf_id    = 6,
        members    = 1/2 (primary/total),
        act_id     = 2249393,
        last_appl. = 0,
        protocols  = 0/9/3 (gcs/repl/appl),
        group UUID = 7eb81e74-d782-11ec-aeb4-3eb52f8f83c4
2022-08-12T17:42:16.290462Z 0 [Warning] WSREP: Donor cfa5fea8-1a55-11ed-b236-06a7d79f15c1 is no longer in the group. State transfer cannot be completed, need to abort. Aborting...
2022-08-12T17:42:16.290467Z 0 [Note] WSREP: Flow-control interval: [2896, 2896]
2022-08-12T17:42:21.732489Z 0 [Note] WSREP:  cleaning up cfa5fea8 (tcp://192.168.170.143:4567)
2022-08-12T17:42:31.117663Z 0 [Note] InnoDB: Buffer pool(s) load completed at 220812 13:42:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@houndegnonm