<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=koi8-r">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">I fixed it with a drbd down/up.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Users <users-bounces@clusterlabs.org>
<b>On Behalf Of </b>Eric Robinson<br>
<b>Sent:</b> Saturday, June 27, 2020 4:32 PM<br>
<b>To:</b> Cluster Labs - All topics related to open-source clustering welcomed <users@clusterlabs.org>; Strahil Nikolov <hunter86_bg@yahoo.com><br>
<b>Subject:</b> Re: [ClusterLabs] DRBD sync stalled at 100% ?<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:black">Thanks for the feedback. I was hoping for a non-downtime solution. No way to do that?<o:p></o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:black">Get
<a href="https://aka.ms/ghei36">Outlook for Android</a><o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="98%" align="center">
</div>
<div id="divRplyFwdMsg">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black"> Strahil Nikolov <<a href="mailto:hunter86_bg@yahoo.com">hunter86_bg@yahoo.com</a>><br>
<b>Sent:</b> Saturday, June 27, 2020 2:40:38 PM<br>
<b>To:</b> Cluster Labs - All topics related to open-source clustering welcomed <<a href="mailto:users@clusterlabs.org">users@clusterlabs.org</a>>; Eric Robinson <<a href="mailto:eric.robinson@psmnv.com">eric.robinson@psmnv.com</a>><br>
<b>Subject:</b> Re: [ClusterLabs] DRBD sync stalled at 100% ?</span> <o:p></o:p></p>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt">I've seen this on a test setup after multiple network disruptions.<br>
I managed to fix it by stopping drbd on all nodes and starting it back.<br>
<br>
I guess you can get downtime and try that approach.<br>
<br>
<br>
Best Regards,<br>
Strahil Nikolov<br>
<br>
<br>
<br>
ξΑ 27 ΐΞΙ 2020 Η. 16:36:10 GMT+03:00, Eric Robinson <<a href="mailto:eric.robinson@psmnv.com">eric.robinson@psmnv.com</a>> ΞΑΠΙΣΑ:<br>
>I'm not seeing anything on Google about this. Two DRBD nodes lost<br>
>communication with each other, and then reconnected and started sync.<br>
>But then it got to 100% and is just stalled there.<br>
><br>
>The nodes are 001db03a, 001db03b.<br>
><br>
>On 001db03a:<br>
><br>
>[root@001db03a ~]# drbdadm status<br>
>ha01_mysql role:Primary<br>
> disk:UpToDate<br>
> 001db03b role:Secondary<br>
> replication:SyncSource peer-disk:Inconsistent done:100.00<br>
><br>
>ha02_mysql role:Secondary<br>
> disk:UpToDate<br>
> 001db03b role:Primary<br>
> peer-disk:UpToDate<br>
><br>
>On 001drbd03b:<br>
><br>
>[root@001db03b ~]# drbdadm status<br>
>ha01_mysql role:Secondary<br>
> disk:Inconsistent<br>
> 001db03a role:Primary<br>
> replication:SyncTarget peer-disk:UpToDate done:100.00<br>
><br>
>ha02_mysql role:Primary<br>
> disk:UpToDate<br>
> 001db03a role:Secondary<br>
> peer-disk:UpToDate<br>
><br>
><br>
>On 001db03a, here are the DRBD messages from the onset of the problem<br>
>until now.<br>
><br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: PingAck did<br>
>not arrive in time.<br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: conn(<br>
>Connected -> NetworkFailure ) peer( Primary -> Unknown )<br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql/0 drbd1: disk(<br>
>UpToDate -> Consistent )<br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>pdsk( UpToDate -> DUnknown ) repl( Established -> Off )<br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: ack_receiver<br>
>terminated<br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: Terminating<br>
>ack_recv thread<br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql: Preparing<br>
>cluster-wide state change 2946943372 (1->-1 0/0)<br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql: Committing<br>
>cluster-wide state change 2946943372 (6ms)<br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql/0 drbd1: disk(<br>
>Consistent -> UpToDate )<br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: Connection<br>
>closed<br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: conn(<br>
>NetworkFailure -> Unconnected )<br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: Restarting<br>
>receiver thread<br>
>Jun 26 22:34:27 001db03a kernel: drbd ha02_mysql 001db03b: conn(<br>
>Unconnected -> Connecting )<br>
>Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: PingAck did<br>
>not arrive in time.<br>
>Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: conn(<br>
>Connected -> NetworkFailure ) peer( Secondary -> Unknown )<br>
>Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b:<br>
>pdsk( UpToDate -> DUnknown ) repl( Established -> Off )<br>
>Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: ack_receiver<br>
>terminated<br>
>Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: Terminating<br>
>ack_recv thread<br>
>Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql/0 drbd0: new current<br>
>UUID: D07A3D4B2F99832D weak: FFFFFFFFFFFFFFFD<br>
>Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: Connection<br>
>closed<br>
>Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: conn(<br>
>NetworkFailure -> Unconnected )<br>
>Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: Restarting<br>
>receiver thread<br>
>Jun 26 22:34:30 001db03a kernel: drbd ha01_mysql 001db03b: conn(<br>
>Unconnected -> Connecting )<br>
>Jun 26 22:34:33 001db03a pengine[1474]: notice: * Start <br>
>p_drbd0:1 ( 001db03b )<br>
>Jun 26 22:34:33 001db03a crmd[1475]: notice: Initiating notify<br>
>operation p_drbd0_pre_notify_start_0 locally on 001db03a<br>
>Jun 26 22:34:33 001db03a crmd[1475]: notice: Result of notify<br>
>operation for p_drbd0 on 001db03a: 0 (ok)<br>
>Jun 26 22:34:33 001db03a crmd[1475]: notice: Initiating start<br>
>operation p_drbd0_start_0 on 001db03b<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql 001db03b: Handshake to<br>
>peer 0 successful: Agreed network protocol version 113<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql 001db03b: Feature<br>
>flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME<br>
>WRITE_ZEROES.<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql 001db03b: Starting<br>
>ack_recv thread (from drbd_r_ha02_mys [2116])<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql 001db03b: Preparing<br>
>remote state change 3920461435<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql 001db03b: Committing<br>
>remote state change 3920461435 (primary_nodes=1)<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql 001db03b: conn(<br>
>Connecting -> Connected ) peer( Unknown -> Primary )<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1: disk(<br>
>UpToDate -> Outdated )<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>drbd_sync_handshake:<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: self<br>
>492F8D33A72A8E08:0000000000000000:659DC04F5C85B6E4:8254EEA2EC50AD7C<br>
>bits:0 flags:120<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: peer<br>
>5A6B1EBE80500C39:492F8D33A72A8E09:659DC04F5C85B6E4:51A00A23ED88187A<br>
>bits:1 flags:120<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>uuid_compare()=-2 by rule 50<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>pdsk( DUnknown -> UpToDate ) repl( Off -> WFBitMapT )<br>
>Jun 26 22:34:34 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23;<br>
>compression: 100.0%<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: send<br>
>bitmap stats [Bytes(packets)]: plain 0(0), RLE 23(1), total 23;<br>
>compression: 100.0%<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>helper command: /sbin/drbdadm before-resync-target<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>helper command: /sbin/drbdadm before-resync-target exit code 0 (0x0)<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1: disk(<br>
>Outdated -> Inconsistent )<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>repl( WFBitMapT -> SyncTarget )<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>Began resync as SyncTarget (will sync 4 KB [1 bits set]).<br>
>Jun 26 22:34:35 001db03a crmd[1475]: notice: Initiating notify<br>
>operation p_drbd0_post_notify_start_0 locally on 001db03a<br>
>Jun 26 22:34:35 001db03a crmd[1475]: notice: Initiating notify<br>
>operation p_drbd0_post_notify_start_0 on 001db03b<br>
>Jun 26 22:34:35 001db03a crmd[1475]: notice: Transition aborted by<br>
>status-2-master-p_drbd0 doing create master-p_drbd0=10000: Transient<br>
>attribute change<br>
>Jun 26 22:34:35 001db03a crmd[1475]: notice: Result of notify<br>
>operation for p_drbd0 on 001db03a: 0 (ok)<br>
>Jun 26 22:34:35 001db03a crmd[1475]: notice: Initiating monitor<br>
>operation p_drbd0_monitor_60000 on 001db03b<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>Resync done (total 1 sec; paused 0 sec; 4 K/sec)<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>updated UUIDs<br>
>5A6B1EBE80500C38:0000000000000000:492F8D33A72A8E08:659DC04F5C85B6E4<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1: disk(<br>
>Inconsistent -> UpToDate )<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>repl( SyncTarget -> Established )<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>helper command: /sbin/drbdadm after-resync-target<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>helper command: /sbin/drbdadm after-resync-target exit code 0 (0x0)<br>
>Jun 26 22:34:35 001db03a crmd[1475]: notice: Transition aborted by<br>
>status-2-master-p_drbd0 doing modify master-p_drbd0=1000: Transient<br>
>attribute change<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql 001db03b: Handshake to<br>
>peer 0 successful: Agreed network protocol version 113<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql 001db03b: Feature<br>
>flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME<br>
>WRITE_ZEROES.<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql 001db03b: Starting<br>
>ack_recv thread (from drbd_r_ha01_mys [2110])<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql 001db03b: Preparing<br>
>remote state change 3458191960<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql 001db03b: Committing<br>
>remote state change 3458191960 (primary_nodes=2)<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql 001db03b: conn(<br>
>Connecting -> Connected ) peer( Unknown -> Secondary )<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b:<br>
>drbd_sync_handshake:<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: self<br>
>D07A3D4B2F99832D:50AE57670FCB98C3:7DDDDEEEEEA477C4:B75C5B6B7AAFBB6A<br>
>bits:22 flags:120<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: peer<br>
>50AE57670FCB98C2:0000000000000000:7DDDDEEEEEA477C4:D2AAA82A5FF6EE84<br>
>bits:0 flags:20<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b:<br>
>uuid_compare()=2 by rule 70<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b:<br>
>pdsk( DUnknown -> Consistent ) repl( Off -> WFBitMapS )<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b: send<br>
>bitmap stats [Bytes(packets)]: plain 0(0), RLE 83(1), total 83;<br>
>compression: 100.0%<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b:<br>
>pdsk( Consistent -> Outdated )<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b:<br>
>receive bitmap stats [Bytes(packets)]: plain 0(0), RLE 83(1), total 83;<br>
>compression: 100.0%<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b:<br>
>helper command: /sbin/drbdadm before-resync-source<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b:<br>
>helper command: /sbin/drbdadm before-resync-source exit code 0 (0x0)<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b:<br>
>pdsk( Outdated -> Inconsistent ) repl( WFBitMapS -> SyncSource )<br>
>Jun 26 22:34:35 001db03a kernel: drbd ha01_mysql/0 drbd0 001db03b:<br>
>Began resync as SyncSource (will sync 212 KB [53 bits set]).<br>
>Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql 001db03b: sock was<br>
>shut down by peer<br>
>Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql 001db03b: conn(<br>
>Connected -> BrokenPipe ) peer( Primary -> Unknown )<br>
>Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql/0 drbd1: disk(<br>
>UpToDate -> Consistent )<br>
>Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>pdsk( UpToDate -> DUnknown ) repl( Established -> Off )<br>
>Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql 001db03b: meta<br>
>connection shut down by peer.<br>
>Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql 001db03b: ack_receiver<br>
>terminated<br>
>Jun 26 22:36:35 001db03a kernel: drbd ha02_mysql 001db03b: Terminating<br>
>ack_recv thread<br>
>Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql: Preparing<br>
>cluster-wide state change 2546365252 (1->-1 0/0)<br>
>Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql: Committing<br>
>cluster-wide state change 2546365252 (9ms)<br>
>Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql/0 drbd1: disk(<br>
>Consistent -> UpToDate )<br>
>Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql 001db03b: Connection<br>
>closed<br>
>Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql 001db03b: conn(<br>
>BrokenPipe -> Unconnected )<br>
>Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql 001db03b: Restarting<br>
>receiver thread<br>
>Jun 26 22:36:39 001db03a kernel: drbd ha02_mysql 001db03b: conn(<br>
>Unconnected -> Connecting )<br>
>Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql 001db03b: Handshake to<br>
>peer 0 successful: Agreed network protocol version 113<br>
>Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql 001db03b: Feature<br>
>flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME<br>
>WRITE_ZEROES.<br>
>Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql 001db03b: Starting<br>
>ack_recv thread (from drbd_r_ha02_mys [2116])<br>
>Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql 001db03b: Preparing<br>
>remote state change 1109150886<br>
>Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql 001db03b: Committing<br>
>remote state change 1109150886 (primary_nodes=1)<br>
>Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql 001db03b: conn(<br>
>Connecting -> Connected ) peer( Unknown -> Primary )<br>
>Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>drbd_sync_handshake:<br>
>Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: self<br>
>5A6B1EBE80500C38:0000000000000000:492F8D33A72A8E08:659DC04F5C85B6E4<br>
>bits:0 flags:120<br>
>Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: peer<br>
>5A6B1EBE80500C39:0000000000000000:492F8D33A72A8E08:659DC04F5C85B6E4<br>
>bits:0 flags:120<br>
>Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>uuid_compare()=0 by rule 38<br>
>Jun 26 22:36:40 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>pdsk( DUnknown -> UpToDate ) repl( Off -> Established )<br>
>Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql 001db03b: PingAck did<br>
>not arrive in time.<br>
>Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql 001db03b: conn(<br>
>Connected -> NetworkFailure ) peer( Primary -> Unknown )<br>
>Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql/0 drbd1: disk(<br>
>UpToDate -> Consistent )<br>
>Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>pdsk( UpToDate -> DUnknown ) repl( Established -> Off )<br>
>Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql 001db03b: ack_receiver<br>
>terminated<br>
>Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql 001db03b: Terminating<br>
>ack_recv thread<br>
>Jun 26 22:39:41 001db03a kernel: drbd ha02_mysql 001db03b: sock was<br>
>shut down by peer<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql: Preparing<br>
>cluster-wide state change 3067178175 (1->-1 0/0)<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql: Committing<br>
>cluster-wide state change 3067178175 (8ms)<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql/0 drbd1: disk(<br>
>Consistent -> UpToDate )<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Connection<br>
>closed<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: conn(<br>
>NetworkFailure -> Unconnected )<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Restarting<br>
>receiver thread<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: conn(<br>
>Unconnected -> Connecting )<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Handshake to<br>
>peer 0 successful: Agreed network protocol version 113<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Feature<br>
>flags enabled on protocol level: 0xf TRIM THIN_RESYNC WRITE_SAME<br>
>WRITE_ZEROES.<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Starting<br>
>ack_recv thread (from drbd_r_ha02_mys [2116])<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Preparing<br>
>remote state change 2747304939<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: Committing<br>
>remote state change 2747304939 (primary_nodes=1)<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql 001db03b: conn(<br>
>Connecting -> Connected ) peer( Unknown -> Primary )<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>drbd_sync_handshake:<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: self<br>
>5A6B1EBE80500C38:0000000000000000:492F8D33A72A8E08:659DC04F5C85B6E4<br>
>bits:0 flags:120<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b: peer<br>
>5A6B1EBE80500C39:0000000000000000:492F8D33A72A8E08:659DC04F5C85B6E4<br>
>bits:0 flags:120<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>uuid_compare()=0 by rule 38<br>
>Jun 26 22:39:45 001db03a kernel: drbd ha02_mysql/0 drbd1 001db03b:<br>
>pdsk( DUnknown -> UpToDate ) repl( Off -> Established )<br>
><br>
>[<a href="cid:image001.png@01D64C5C.FA76F310">cid:image001.png@01D64C5C.FA76F310</a>]<br>
><br>
>Disclaimer : This email and any files transmitted with it are<br>
>confidential and intended solely for intended recipients. If you are<br>
>not the named addressee you should not disseminate, distribute, copy or<br>
>alter this email. Any views or opinions presented in this email are<br>
>solely those of the author and might not represent those of Physician<br>
>Select Management. Warning: Although Physician Select Management has<br>
>taken reasonable precautions to ensure no viruses are present in this<br>
>email, the company cannot accept responsibility for any loss or damage<br>
>arising from the use of this email or attachments.<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal">Disclaimer : This email and any files transmitted with it are confidential and intended solely for intended recipients. If you are not the named addressee you should not disseminate, distribute, copy or alter this email. Any views or opinions
presented in this email are solely those of the author and might not represent those of Physician Select Management. Warning: Although Physician Select Management has taken reasonable precautions to ensure no viruses are present in this email, the company
cannot accept responsibility for any loss or damage arising from the use of this email or attachments.
<o:p></o:p></p>
</div>
</div>
Disclaimer : This email and any files transmitted with it are confidential and intended solely for intended recipients. If you are not the named addressee you should not disseminate, distribute, copy or alter this email. Any views or opinions presented in this
email are solely those of the author and might not represent those of Physician Select Management. Warning: Although Physician Select Management has taken reasonable precautions to ensure no viruses are present in this email, the company cannot accept responsibility
for any loss or damage arising from the use of this email or attachments.
</body>
</html>