<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">I’m not seeing anything on Google about this. Two DRBD nodes lost communication with each other, and then reconnected and started sync. But then it got to 100% and is just stalled there.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The nodes are 001db03a, 001db03b.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">On 001db03a:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">[root@001db03a ~]# drbdadm status<o:p></o:p></p>
<p class="MsoNormal">ha01_mysql role:Primary<o:p></o:p></p>
<p class="MsoNormal"> disk:UpToDate<o:p></o:p></p>
<p class="MsoNormal"> 001db03b role:Secondary<o:p></o:p></p>
<p class="MsoNormal"> replication:SyncSource peer-disk:Inconsistent done:100.00<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">ha02_mysql role:Secondary<o:p></o:p></p>
<p class="MsoNormal"> disk:UpToDate<o:p></o:p></p>
<p class="MsoNormal"> 001db03b role:Primary<o:p></o:p></p>
<p class="MsoNormal"> peer-disk:UpToDate<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">On 001drbd03b:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">[root@001db03b ~]# drbdadm status<o:p></o:p></p>
<p class="MsoNormal">ha01_mysql role:Secondary<o:p></o:p></p>
<p class="MsoNormal"> disk:Inconsistent<o:p></o:p></p>
<p class="MsoNormal"> 001db03a role:Primary<o:p></o:p></p>
<p class="MsoNormal"> replication:SyncTarget peer-disk:UpToDate done:100.00<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">ha02_mysql role:Primary<o:p></o:p></p>
<p class="MsoNormal"> disk:UpToDate<o:p></o:p></p>
<p class="MsoNormal"> 001db03a role:Secondary<o:p></o:p></p>
<p class="MsoNormal"> peer-disk:UpToDate<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">On 001db03a, here are the DRBD messages from the onset of the problem until now.
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: PingAck did not arrive in time.<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: conn( Connected -> NetworkFailure ) peer( Primary -> Unknown )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql/0 drbd1: disk( UpToDate -> Consistent )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: pdsk( UpToDate -> DUnknown ) repl( Established -> Off )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: ack_receiver terminated<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: Terminating ack_recv thread<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql: Preparing cluster-wide state change 2946943372 (1->-1 0/0)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql: Committing cluster-wide state change 2946943372 (6ms)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql/0 drbd1: disk( Consistent -> UpToDate )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: Connection closed<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: conn( NetworkFailure -> Unconnected )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: Restarting receiver thread<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: conn( Unconnected -> Connecting )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: PingAck did not arrive in time.<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: conn( Connected -> NetworkFailure ) peer( Secondary -> Unknown )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: pdsk( UpToDate -> DUnknown ) repl( Established -> Off )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: ack_receiver terminated<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: Terminating ack_recv thread<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql/0 drbd0: new current UUID: D07A3D4B2F99832D weak: FFFFFFFFFFFFFFFD<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: Connection closed<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: conn( NetworkFailure -> Unconnected )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: Restarting receiver thread<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: conn( Unconnected -> Connecting )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:33 001db03a pengine[1474]: notice: * Start p_drbd0:1 ( 001db03b )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:33 001db03a crmd[1475]: notice: Initiating notify operation p_drbd0_pre_notify_start_0 locally on 001db03a<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:33 001db03a crmd[1475]: notice: Result of notify operation for p_drbd0 on 001db03a: 0 (ok)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:33 001db03a crmd[1475]: notice: Initiating start operation p_drbd0_start_0 on 001db03b<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql 001db03b: Handshake to peer 0 successful: Agreed network protocol version 113<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql 001db03b: Feature flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES.<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql 001db03b: Starting ack_recv thread (from drbd_r_ha02_mys [2116])<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql 001db03b: Preparing remote state change 3920461435<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql 001db03b: Committing remote state change 3920461435 (primary_nodes=1)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql 001db03b: conn( Connecting -> Connected ) peer( Unknown -> Primary )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1: disk( UpToDate -> Outdated )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: drbd_sync_handshake:<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: self 492F8D33A72A8E08:0000000000000000:659DC04F5C85B6E4:8254EEA2EC50AD7C bits:0 flags:120<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: peer 5A6B1EBE80500C39:492F8D33A72A8E09:659DC04F5C85B6E4:51A00A23ED88187A bits:1 flags:120<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: uuid_compare()=-2 by rule 50<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: pdsk( DUnknown -> UpToDate ) repl( Off -> WFBitMapT )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23; compression: 100.0%<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: helper command: /sbin/drbdadm before-resync-target<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: helper command: /sbin/drbdadm before-resync-target exit code 0 (0x0)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1: disk( Outdated -> Inconsistent )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: repl( WFBitMapT -> SyncTarget )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: Began resync as SyncTarget (will sync 4 KB [1 bits set]).<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a crmd[1475]: notice: Initiating notify operation p_drbd0_post_notify_start_0 locally on 001db03a<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a crmd[1475]: notice: Initiating notify operation p_drbd0_post_notify_start_0 on 001db03b<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a crmd[1475]: notice: Transition aborted by status-2-master-p_drbd0 doing create master-p_drbd0=10000: Transient attribute change<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a crmd[1475]: notice: Result of notify operation for p_drbd0 on 001db03a: 0 (ok)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a crmd[1475]: notice: Initiating monitor operation p_drbd0_monitor_60000 on 001db03b<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: Resync done (total 1 sec; paused 0 sec; 4 K/sec)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: updated UUIDs 5A6B1EBE80500C38:0000000000000000:492F8D33A72A8E08:659DC04F5C85B6E4<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1: disk( Inconsistent -> UpToDate )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: repl( SyncTarget -> Established )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: helper command: /sbin/drbdadm after-resync-target<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: helper command: /sbin/drbdadm after-resync-target exit code 0 (0x0)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a crmd[1475]: notice: Transition aborted by status-2-master-p_drbd0 doing modify master-p_drbd0=1000: Transient attribute change<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql 001db03b: Handshake to peer 0 successful: Agreed network protocol version 113<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql 001db03b: Feature flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES.<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql 001db03b: Starting ack_recv thread (from drbd_r_ha01_mys [2110])<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql 001db03b: Preparing remote state change 3458191960<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql 001db03b: Committing remote state change 3458191960 (primary_nodes=2)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql 001db03b: conn( Connecting -> Connected ) peer( Unknown -> Secondary )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: drbd_sync_handshake:<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: self D07A3D4B2F99832D:50AE57670FCB98C3:7DDDDEEEEEA477C4:B75C5B6B7AAFBB6A bits:22 flags:120<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: peer 50AE57670FCB98C2:0000000000000000:7DDDDEEEEEA477C4:D2AAA82A5FF6EE84 bits:0 flags:20<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: uuid_compare()=2 by rule 70<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: pdsk( DUnknown -> Consistent ) repl( Off -> WFBitMapS )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: send bitmap stats [Bytes(packets)]: plain 0(0), RLE 83(1), total 83; compression: 100.0%<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: pdsk( Consistent -> Outdated )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 83(1), total 83; compression: 100.0%<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: helper command: /sbin/drbdadm before-resync-source<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: helper command: /sbin/drbdadm before-resync-source exit code 0 (0x0)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: pdsk( Outdated -> Inconsistent ) repl( WFBitMapS -> SyncSource )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: Began resync as SyncSource (will sync 212 KB [53 bits set]).<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql 001db03b: sock was shut down by peer<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql 001db03b: conn( Connected -> BrokenPipe ) peer( Primary -> Unknown )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql/0 drbd1: disk( UpToDate -> Consistent )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: pdsk( UpToDate -> DUnknown ) repl( Established -> Off )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql 001db03b: meta connection shut down by peer.<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql 001db03b: ack_receiver terminated<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql 001db03b: Terminating ack_recv thread<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql: Preparing cluster-wide state change 2546365252 (1->-1 0/0)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql: Committing cluster-wide state change 2546365252 (9ms)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql/0 drbd1: disk( Consistent -> UpToDate )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql 001db03b: Connection closed<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql 001db03b: conn( BrokenPipe -> Unconnected )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql 001db03b: Restarting receiver thread<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql 001db03b: conn( Unconnected -> Connecting )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql 001db03b: Handshake to peer 0 successful: Agreed network protocol version 113<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql 001db03b: Feature flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES.<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql 001db03b: Starting ack_recv thread (from drbd_r_ha02_mys [2116])<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql 001db03b: Preparing remote state change 1109150886<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql 001db03b: Committing remote state change 1109150886 (primary_nodes=1)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql 001db03b: conn( Connecting -> Connected ) peer( Unknown -> Primary )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: drbd_sync_handshake:<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: self 5A6B1EBE80500C38:0000000000000000:492F8D33A72A8E08:659DC04F5C85B6E4 bits:0 flags:120<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: peer 5A6B1EBE80500C39:0000000000000000:492F8D33A72A8E08:659DC04F5C85B6E4 bits:0 flags:120<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: uuid_compare()=0 by rule 38<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: pdsk( DUnknown -> UpToDate ) repl( Off -> Established )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql 001db03b: PingAck did not arrive in time.<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql 001db03b: conn( Connected -> NetworkFailure ) peer( Primary -> Unknown )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql/0 drbd1: disk( UpToDate -> Consistent )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: pdsk( UpToDate -> DUnknown ) repl( Established -> Off )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql 001db03b: ack_receiver terminated<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql 001db03b: Terminating ack_recv thread<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql 001db03b: sock was shut down by peer<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql: Preparing cluster-wide state change 3067178175 (1->-1 0/0)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql: Committing cluster-wide state change 3067178175 (8ms)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql/0 drbd1: disk( Consistent -> UpToDate )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Connection closed<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: conn( NetworkFailure -> Unconnected )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Restarting receiver thread<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: conn( Unconnected -> Connecting )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Handshake to peer 0 successful: Agreed network protocol version 113<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Feature flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME WRITE_ZEROES.<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Starting ack_recv thread (from drbd_r_ha02_mys [2116])<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Preparing remote state change 2747304939<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Committing remote state change 2747304939 (primary_nodes=1)<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: conn( Connecting -> Connected ) peer( Unknown -> Primary )<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: drbd_sync_handshake:<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: self 5A6B1EBE80500C38:0000000000000000:492F8D33A72A8E08:659DC04F5C85B6E4 bits:0 flags:120<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: peer 5A6B1EBE80500C39:0000000000000000:492F8D33A72A8E08:659DC04F5C85B6E4 bits:0 flags:120<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: uuid_compare()=0 by rule 38<o:p></o:p></p>
<p class="MsoNormal">Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: pdsk( DUnknown -> UpToDate ) repl( Off -> Established )<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><img width="500" height="96" style="width:5.2083in;height:1.0in" id="Picture_x0020_1" src="cid:image001.png@01D64C5C.FA76F310"><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
Disclaimer : This email and any files transmitted with it are confidential and intended solely for intended recipients. If you are not the named addressee you should not disseminate, distribute, copy or alter this email. Any views or opinions presented in this
email are solely those of the author and might not represent those of Physician Select Management. Warning: Although Physician Select Management has taken reasonable precautions to ensure no viruses are present in this email, the company cannot accept responsibility
for any loss or damage arising from the use of this email or attachments.
</body>
</html>