[ClusterLabs] pgsql Master/Slave set has no promote (all nodes are slaves)
Andrey Rubik
tirnotaure at gmail.com
Mon Oct 12 14:44:23 UTC 2015
Thanks for reply.
Now I testing only Master/Slave configuration, but before i tried full
configuration with same results:
pcs cluster cib pgsql_cfg
pcs -f pgsql_cfg property set no-quorum-policy="ignore"
pcs -f pgsql_cfg property set stonith-enabled="false"
pcs -f pgsql_cfg resource defaults resource-stickiness="INFINITY"
pcs -f pgsql_cfg resource defaults migration-threshold="2"
pcs -f pgsql_cfg resource create vip-master IPaddr2 \
ip="10.200.200.225" \
nic="eth0" \
cidr_netmask="24" \
op start timeout="60s" interval="0s" on-fail="restart" \
op monitor timeout="60s" interval="10s" on-fail="restart" \
op stop timeout="60s" interval="0s" on-fail="block"
pcs -f pgsql_cfg resource create vip-rep IPaddr2 \
ip="10.200.200.224" \
nic="eth0" \
cidr_netmask="24" \
meta migration-threshold="0" \
op start timeout="60s" interval="0s" on-fail="stop" \
op monitor timeout="60s" interval="10s" on-fail="restart" \
op stop timeout="60s" interval="0s" on-fail="ignore"
pcs -f pgsql_cfg resource create pgsql pgsql \
pgctl="/usr/pgsql-9.3/bin/pg_ctl" \
psql="/usr/pgsql-9.3/bin/psql" \
pgdata="/var/lib/pgsql/9.3/data/" \
tmpdir="/var/lib/pgsql/9.3/tmp/" \
rep_mode="sync" \
node_list="pg1 pg2" \
restore_command="cp /var/lib/pgsql/9.3/backups/%f %p" \
primary_conninfo_opt="keepalives_idle=60 keepalives_interval=5
keepalives_count=5" \
master_ip="10.200.200.225" \
restart_on_promote='false' \
op start timeout="60s" interval="0s" on-fail="restart" \
op monitor timeout="60s" interval="4s" on-fail="restart" \
op monitor timeout="60s" interval="3s" on-fail="restart"
role="Master" \
op promote timeout="60s" interval="0s" on-fail="restart" \
op demote timeout="60s" interval="0s" on-fail="stop" \
op stop timeout="60s" interval="0s" on-fail="block" \
op notify timeout="60s" interval="0s"
pcs -f pgsql_cfg resource master msPostgresql pgsql \
master-max=1 master-node-max=1 clone-max=2 clone-node-max=1 notify=true
pcs -f pgsql_cfg resource group add master-group vip-master vip-rep
pcs -f pgsql_cfg constraint colocation add master-group with Master
msPostgresql INFINITY
pcs -f pgsql_cfg constraint order promote msPostgresql then start
master-group symmetrical=false score=INFINITY
pcs -f pgsql_cfg constraint order demote msPostgresql then stop
master-group symmetrical=false score=0
pcs cluster cib-push pgsql_cfg
crm_mon in this case:
Stack: corosync
Current DC: pm2 (version 1.1.13-a14efad) - partition with quorum
2 nodes and 4 resources configured
Online: [ pm1 pm2 ]
Full list of resources:
Master/Slave Set: msPostgresql [pgsql]
Slaves: [ pm1 pm2 ]
Resource Group: master-group
vip-master (ocf::heartbeat:IPaddr2): Stopped
vip-rep (ocf::heartbeat:IPaddr2): Stopped
Node Attributes:
* Node pm1:
+ master-pgsql : -INFINITY
+ pgsql-status : HS:alone
+ pgsql-xlog-loc : 0000000000000000
* Node pm2:
+ pgsql-status : HS:alone
+ pgsql-xlog-loc : 0000000000000000
Migration Summary:
* Node pm2:
* Node pm1:
On 12.10.2015 17:36, Nikolay Popov wrote:
> Hi, Andrey.
>
> You added VIP?
> That is a VIP (master_ip="10.200.200.233")?
>
>
>
> 12.10.2015 17:23, Andrey Rubik пишет:
>> Hi all.
>>
>> I'm trying to configure pgsql Master/Slave set with 2 nodes.
>>
>> I'm get successful installation Master/Slave without pacemaker.
>>
>> Pacemaker version:
>>
>> pacemakerd --features
>> Pacemaker 1.1.13 (Build: a14efad)
>> Supporting v3.0.10: generated-manpages agent-manpages ascii-docs
>> publican-docs ncurses libqb-logging libqb-ipc upstart systemd nagios
>> corosync-native atomic-attrd acls
>>
>> That's my configuration:
>>
>> pcs cluster cib pgsql_cfg
>>
>> pcs -f pgsql_cfg property set no-quorum-policy="ignore"
>> pcs -f pgsql_cfg property set stonith-enabled="false"
>>
>> pcs -f pgsql_cfg resource create pgsql pgsql \
>> pgctl="/usr/pgsql-9.3/bin/pg_ctl" \
>> psql="/usr/pgsql-9.3/bin/psql" \
>> pgdata="/var/lib/pgsql/9.3/data/" \
>> tmpdir="/var/lib/pgsql/9.3/tmp/" \
>> rep_mode="sync" \
>> node_list="pg1 pg2" \
>> restore_command="cp /var/lib/pgsql/9.3/backups/%f %p" \
>> primary_conninfo_opt="keepalives_idle=60 keepalives_interval=5
>> keepalives_count=5" \
>> master_ip="10.200.200.233" \
>> restart_on_promote='true' \
>> op start timeout="60s" interval="0s" on-fail="restart" \
>> op monitor timeout="60s" interval="4s" on-fail="restart" \
>> op monitor timeout="60s" interval="3s" on-fail="restart"
>> role="Master" \
>> op promote timeout="60s" interval="0s" on-fail="restart" \
>> op demote timeout="60s" interval="0s" on-fail="stop" \
>> op stop timeout="60s" interval="0s" on-fail="block" \
>> op notify timeout="60s" interval="0s"
>>
>> pcs -f pgsql_cfg resource master msPostgresql pgsql \
>> master-max=1 master-node-max=1 clone-max=2 clone-node-max=1
>> notify=true
>>
>> pcs cluster cib-push pgsql_cfg
>>
>>
>>
>> crm_mon:
>>
>> Stack: corosync
>> Current DC: pm2 (version 1.1.13-a14efad) - partition with quorum
>> 2 nodes and 2 resources configured
>>
>> Online: [ pm1 pm2 ]
>>
>> Full list of resources:
>>
>> Master/Slave Set: msPostgresql [pgsql]
>> Slaves: [ pm1 pm2 ]
>>
>> Node Attributes:
>> * Node pm1:
>> + master-pgsql : -INFINITY
>> + pgsql-data-status : LATEST
>> + pgsql-status : HS:alone
>> + pgsql-xlog-loc : 0000000000000000
>> * Node pm2:
>> + master-pgsql : -INFINITY
>> + pgsql-data-status : LATEST
>> + pgsql-master-baseline : 0000000000000000
>> + pgsql-status : HS:alone
>> + pgsql-xlog-loc : 0000000000000000
>>
>> Migration Summary:
>> * Node pm2:
>> * Node pm1:
>>
>>
>>
>> /var/log/pacemaker.log:
>>
>> WARNING: Can't get pg1 xlog location.
>> WARNING: Can't get pg2 xlog location.
>> WARNING: Can't get pg1 xlog location.
>> WARNING: Can't get pg2 xlog location.
>> .....
>>
>> Its very strange messages since i have pgsql-xlog-loc in crm_mon.
>>
>>
>>
>>
>> If I try set master manually it fails and then stop pm1 node:
>>
>> crm_resource -N pm1 -r pgsql --force-promote
>>
>> Operation promote for pgsql:0 (ocf:heartbeat:pgsql) returned 0
>> > stderr: INFO: Creating /var/lib/pgsql/9.3/tmp//PGSQL.lock.
>> > stderr: INFO: My master baseline : 0000000000000000.
>> > stderr: INFO: Restarting PostgreSQL instead of promote.
>> > stderr: INFO: waiting for server to shut down.... done server
>> stopped
>> > stderr: INFO: PostgreSQL is down
>> > stderr: INFO: server starting
>> > stderr: INFO: PostgreSQL start command sent.
>> > stderr: psql: could not connect to server: No such file or directory
>> > stderr: Is the server running locally and accepting
>> > stderr: connections on Unix domain socket "/tmp/.s.PGSQL.5432"?
>> > stderr: WARNING: Can't get PostgreSQL recovery status. rc=2
>> > stderr: WARNING: Connection error (connection to the server went
>> bad and the session was not interactive) occurred while executing the
>> psql command.
>> > stderr: DEBUG: PostgreSQL still hasn't started yet. Waiting...
>> > stderr: DEBUG: PostgreSQL is running as a primary.
>> > stderr: INFO: PostgreSQL is started.
>> > stderr: INFO: Changing pgsql-status on pm1 : HS:alone->PRI.
>>
>> crm_mon:
>>
>> Stack: corosync
>> Current DC: pm2 (version 1.1.13-a14efad) - partition with quorum
>> 2 nodes and 2 resources configured
>>
>> Online: [ pm1 pm2 ]
>>
>> Full list of resources:
>>
>> Master/Slave Set: msPostgresql [pgsql]
>> Slaves: [ pm2 ]
>> Stopped: [ pm1 ]
>>
>> Node Attributes:
>> * Node pm1:
>> + master-pgsql : -INFINITY
>> + master-pgsql:0 : 1000
>> + pgsql-data-status : LATEST
>> + pgsql-status : STOP
>> * Node pm2:
>> + master-pgsql : -INFINITY
>> + pgsql-data-status : LATEST
>> + pgsql-master-baseline : 0000000000000000
>> + pgsql-status : HS:alone
>> + pgsql-xlog-loc : 0000000000000000
>>
>> Migration Summary:
>> * Node pm2:
>> * Node pm1:
>> pgsql: migration-threshold=1000000 fail-count=1000000
>> last-failure='Mon Oct 12 17:12:04 2015'
>>
>> Failed Actions:
>> * pgsql_start_0 on pm1 'unknown error' (1): call=47, status=complete,
>> exitreason='My data may be inconsistent. You have to remove
>> /var/lib/pgsql/9.3/tmp//PGSQL.lock file to force start.',
>> last-rc-change='Mon Oct 12 17:12:04 2015', queued=0ms, exec=170ms
>>
>>
>>
>> That is verbose variant:
>> rm -f /var/lib/pgsql/9.3/tmp//PGSQL.lock
>> crm_resource -N pm1 -r pgsql --force-promote -V
>> Operation promote for pgsql:0 (ocf:heartbeat:pgsql) returned 0
>> > stderr: + 17:14:11: 22: '[' -x /sbin/runuser ']'
>> > stderr: + 17:14:11: 23: SU=runuser
>> > stderr: + 17:14:11: 45: OCF_RESKEY_pgctl_default=/usr/bin/pg_ctl
>> > stderr: + 17:14:11: 46: OCF_RESKEY_psql_default=/usr/bin/psql
>> > stderr: + 17:14:11: 47:
>> OCF_RESKEY_pgdata_default=/var/lib/pgsql/data
>> > stderr: + 17:14:11: 48: OCF_RESKEY_pgdba_default=postgres
>> > stderr: + 17:14:11: 49: OCF_RESKEY_pghost_default=
>> > stderr: + 17:14:11: 50: OCF_RESKEY_pgport_default=5432
>> > stderr: + 17:14:11: 51: OCF_RESKEY_pglibs_default=/usr/lib
>> > stderr: + 17:14:11: 52: OCF_RESKEY_start_opt_default=
>> > stderr: + 17:14:11: 53: OCF_RESKEY_pgdb_default=template1
>> > stderr: + 17:14:11: 54: OCF_RESKEY_logfile_default=/dev/null
>> > stderr: + 17:14:11: 55: OCF_RESKEY_stop_escalate_default=30
>> > stderr: + 17:14:11: 56: OCF_RESKEY_monitor_user_default=
>> > stderr: + 17:14:11: 57: OCF_RESKEY_monitor_password_default=
>> > stderr: + 17:14:11: 58: OCF_RESKEY_monitor_sql_default='select
>> now();'
>> > stderr: + 17:14:11: 59: OCF_RESKEY_check_wal_receiver_default=false
>> > stderr: + 17:14:11: 61: OCF_RESKEY_rep_mode_default=none
>> > stderr: + 17:14:11: 62: OCF_RESKEY_node_list_default=
>> > stderr: + 17:14:11: 63: OCF_RESKEY_restore_command_default=
>> > stderr: + 17:14:11: 64: OCF_RESKEY_archive_cleanup_command_default=
>> > stderr: + 17:14:11: 65: OCF_RESKEY_recovery_end_command_default=
>> > stderr: + 17:14:11: 66: OCF_RESKEY_master_ip_default=
>> > stderr: + 17:14:11: 67: OCF_RESKEY_repuser_default=postgres
>> > stderr: + 17:14:11: 68: OCF_RESKEY_primary_conninfo_opt_default=
>> > stderr: + 17:14:11: 69: OCF_RESKEY_restart_on_promote_default=false
>> > stderr: + 17:14:11: 70: OCF_RESKEY_tmpdir_default=/var/lib/pgsql/tmp
>> > stderr: + 17:14:11: 71: OCF_RESKEY_xlog_check_count_default=3
>> > stderr: + 17:14:11: 72: OCF_RESKEY_crm_attr_timeout_default=5
>> > stderr: + 17:14:11: 73: OCF_RESKEY_stop_escalate_in_slave_default=30
>> > stderr: + 17:14:11: 74: OCF_RESKEY_replication_slot_name_default=
>> > stderr: + 17:14:11: 76: : /usr/pgsql-9.3/bin/pg_ctl
>> > stderr: + 17:14:11: 77: : /usr/pgsql-9.3/bin/psql
>> > stderr: + 17:14:11: 78: : /var/lib/pgsql/9.3/data/
>> > stderr: + 17:14:11: 79: : postgres
>> > stderr: + 17:14:11: 80: :
>> > stderr: + 17:14:11: 81: : 5432
>> > stderr: + 17:14:11: 82: : /usr/lib
>> > stderr: + 17:14:11: 83: : /var/lib/pgsql/9.3/data//postgresql.conf
>> > stderr: + 17:14:11: 84: :
>> > stderr: + 17:14:11: 85: : template1
>> > stderr: + 17:14:11: 86: : /dev/null
>> > stderr: + 17:14:11: 87: : 30
>> > stderr: + 17:14:11: 88: :
>> > stderr: + 17:14:11: 89: :
>> > stderr: + 17:14:11: 90: : select 'now();'
>> > stderr: + 17:14:11: 91: : false
>> > stderr: + 17:14:11: 94: : sync
>> > stderr: + 17:14:11: 95: : pg1 pg2
>> > stderr: + 17:14:11: 96: : cp /var/lib/pgsql/9.3/backups/%f %p
>> > stderr: + 17:14:11: 97: :
>> > stderr: + 17:14:11: 98: :
>> > stderr: + 17:14:11: 99: : 10.200.200.233
>> > stderr: + 17:14:11: 100: : postgres
>> > stderr: + 17:14:11: 101: : keepalives_idle=60
>> keepalives_interval=5 keepalives_count=5
>> > stderr: + 17:14:11: 102: : true
>> > stderr: + 17:14:11: 103: : /var/lib/pgsql/9.3/tmp/
>> > stderr: + 17:14:11: 104: : 3
>> > stderr: + 17:14:11: 105: : 5
>> > stderr: + 17:14:11: 106: : 30
>> > stderr: + 17:14:11: 107: :
>> > stderr: + 17:14:11: 1935: '[' 1 -ne 1 ']'
>> > stderr: + 17:14:11: 1942:
>> PIDFILE=/var/lib/pgsql/9.3/data//postmaster.pid
>> > stderr: + 17:14:11: 1943:
>> BACKUPLABEL=/var/lib/pgsql/9.3/data//backup_label
>> > stderr: ++ 17:14:11: 1944: echo pgsql:0
>> > stderr: ++ 17:14:11: 1944: cut -d : -f 1
>> > stderr: + 17:14:11: 1944: RESOURCE_NAME=pgsql
>> > stderr: + 17:14:11: 1945:
>> PGSQL_WAL_RECEIVER_STATUS_ATTR=pgsql-receiver-status
>> > stderr: + 17:14:11: 1946:
>> RECOVERY_CONF=/var/lib/pgsql/9.3/data//recovery.conf
>> > stderr: ++ 17:14:11: 1947: ocf_local_nodename
>> > stderr: ++ 17:14:11: 1947: tr '[A-Z]' '[a-z]'
>> > stderr: ++ 17:14:11: ocf_local_nodename:570: which pacemakerd
>> > stderr: ++ 17:14:11: ocf_local_nodename:571: '[' 0 -eq 0 ']'
>> > stderr: +++ 17:14:11: ocf_local_nodename:572: pacemakerd '-$'
>> > stderr: +++ 17:14:12: ocf_local_nodename:572: grep 'Pacemaker .*'
>> > stderr: +++ 17:14:12: ocf_local_nodename:572: awk '{ print $2 }'
>> > stderr: ++ 17:14:12: ocf_local_nodename:572: local version=1.1.13
>> > stderr: +++ 17:14:12: ocf_local_nodename:573: echo 1.1.13
>> > stderr: +++ 17:14:12: ocf_local_nodename:573: awk -F- '{ print $1 }'
>> > stderr: ++ 17:14:12: ocf_local_nodename:573: version=1.1.13
>> > stderr: ++ 17:14:12: ocf_local_nodename:574: ocf_version_cmp
>> 1.1.13 1.1.8
>> > stderr: ++ 17:14:12: ocf_version_cmp:543: ocf_is_ver 1.1.13
>> > stderr: ++ 17:14:12: ocf_is_ver:513: grep '^[0-9][0-9.-]*[0-9]$'
>> > stderr: ++ 17:14:12: ocf_is_ver:513: echo 1.1.13
>> > stderr: ++ 17:14:12: ocf_version_cmp:544: ocf_is_ver 1.1.8
>> > stderr: ++ 17:14:12: ocf_is_ver:513: grep '^[0-9][0-9.-]*[0-9]$'
>> > stderr: ++ 17:14:12: ocf_is_ver:513: echo 1.1.8
>> > stderr: ++ 17:14:12: ocf_version_cmp:545: local v1=1.1.13
>> > stderr: ++ 17:14:12: ocf_version_cmp:546: local v2=1.1.8
>> > stderr: +++ 17:14:12: ocf_version_cmp:547: ocf_ver_level 1.1.13
>> > stderr: +++ 17:14:12: ocf_ver_level:521: awk '-F[.-]' '{print NF}'
>> > stderr: +++ 17:14:12: ocf_ver_level:521: echo 1.1.13
>> > stderr: ++ 17:14:12: ocf_version_cmp:547: local v1_level=3
>> > stderr: +++ 17:14:12: ocf_version_cmp:548: ocf_ver_level 1.1.8
>> > stderr: +++ 17:14:12: ocf_ver_level:521: awk '-F[.-]' '{print NF}'
>> > stderr: +++ 17:14:12: ocf_ver_level:521: echo 1.1.8
>> > stderr: ++ 17:14:12: ocf_version_cmp:548: local v2_level=3
>> > stderr: ++ 17:14:12: ocf_version_cmp:549: local level_diff
>> > stderr: ++ 17:14:12: ocf_version_cmp:550: '[' 3 -lt 3 ']'
>> > stderr: ++ 17:14:12: ocf_version_cmp:553: '[' 3 -gt 3 ']'
>> > stderr: +++ 17:14:12: ocf_version_cmp:557: ocf_ver2num 1.1.13
>> > stderr: +++ 17:14:12: ocf_ver2num:516: awk '-F[.-]' '
>> > stderr: {for(i=1; i<=NF; i++) s=s*1000+$i; print s}
>> > stderr: '
>> > stderr: +++ 17:14:12: ocf_ver2num:516: echo 1.1.13
>> > stderr: ++ 17:14:12: ocf_version_cmp:557: v1=1001013
>> > stderr: +++ 17:14:12: ocf_version_cmp:558: ocf_ver2num 1.1.8
>> > stderr: +++ 17:14:12: ocf_ver2num:516: awk '-F[.-]' '
>> > stderr: {for(i=1; i<=NF; i++) s=s*1000+$i; print s}
>> > stderr: '
>> > stderr: +++ 17:14:12: ocf_ver2num:516: echo 1.1.8
>> > stderr: ++ 17:14:12: ocf_version_cmp:558: v2=1001008
>> > stderr: ++ 17:14:12: ocf_version_cmp:559: '[' 1001013 -eq 1001008
>> ']'
>> > stderr: ++ 17:14:12: ocf_version_cmp:561: '[' 1001013 -lt 1001008
>> ']'
>> > stderr: ++ 17:14:12: ocf_version_cmp:564: return 2
>> > stderr: ++ 17:14:12: ocf_local_nodename:575: '[' 2 -eq 2 ']'
>> > stderr: ++ 17:14:12: ocf_local_nodename:576: which crm_node
>> > stderr: ++ 17:14:12: ocf_local_nodename:577: '[' 0 -eq 0 ']'
>> > stderr: ++ 17:14:12: ocf_local_nodename:578: crm_node -n
>> > stderr: ++ 17:14:12: ocf_local_nodename:579: return
>> > stderr: + 17:14:12: 1947: NODENAME=pm1
>> > stderr: + 17:14:12: 1949: is_replication
>> > stderr: + 17:14:12: is_replication:1287: '[' sync '!=' none -a
>> sync '!=' slave ']'
>> > stderr: + 17:14:12: is_replication:1288: return 0
>> > stderr: + 17:14:12: 1950:
>> REP_MODE_CONF=/var/lib/pgsql/9.3/tmp//rep_mode.conf
>> > stderr: + 17:14:12: 1951:
>> PGSQL_LOCK=/var/lib/pgsql/9.3/tmp//PGSQL.lock
>> > stderr: + 17:14:12: 1952:
>> XLOG_NOTE_FILE=/var/lib/pgsql/9.3/tmp//xlog_note
>> > stderr: + 17:14:12: 1954: CRM_MASTER='/usr/sbin/crm_master -l
>> reboot'
>> > stderr: + 17:14:12: 1955:
>> CRM_ATTR_REBOOT='/usr/sbin/crm_attribute -l reboot'
>> > stderr: + 17:14:12: 1956:
>> CRM_ATTR_FOREVER='/usr/sbin/crm_attribute -l forever'
>> > stderr: + 17:14:12: 1957: CRM_FAILCOUNT=/usr/sbin/crm_failcount
>> > stderr: + 17:14:12: 1959: CAN_NOT_PROMOTE=-INFINITY
>> > stderr: + 17:14:12: 1960: CAN_PROMOTE=100
>> > stderr: + 17:14:12: 1961: PROMOTE_ME=1000
>> > stderr: + 17:14:12: 1963: CHECK_MS_SQL='select pg_is_in_recovery()'
>> > stderr: + 17:14:12: 1964: CHECK_XLOG_LOC_SQL='select
>> pg_last_xlog_replay_location(),pg_last_xlog_receive_location()'
>> > stderr: + 17:14:12: 1965: CHECK_REPLICATION_STATE_SQL='select
>> application_name,upper(state),upper(sync_state) from
>> pg_stat_replication'
>> > stderr: + 17:14:12: 1967: PGSQL_STATUS_ATTR=pgsql-status
>> > stderr: + 17:14:12: 1968: PGSQL_DATA_STATUS_ATTR=pgsql-data-status
>> > stderr: + 17:14:12: 1969: PGSQL_XLOG_LOC_NAME=pgsql-xlog-loc
>> > stderr: + 17:14:12: 1970:
>> PGSQL_MASTER_BASELINE=pgsql-master-baseline
>> > stderr: ++ 17:14:12: 1972: echo pg1 pg2
>> > stderr: ++ 17:14:12: 1972: tr '[A-Z]' '[a-z]'
>> > stderr: + 17:14:12: 1972: NODE_LIST='pg1 pg2'
>> > stderr: + 17:14:12: 1973: RE_CONTROL_SLAVE=false
>> > stderr: + 17:14:12: 1976: case "$1" in
>> > stderr: + 17:14:12: 1984: pgsql_validate_all
>> > stderr: + 17:14:12: pgsql_validate_all:1749: local version
>> > stderr: + 17:14:12: pgsql_validate_all:1750: local check_config_rc
>> > stderr: + 17:14:12: pgsql_validate_all:1751: local rep_mode_string
>> > stderr: + 17:14:12: pgsql_validate_all:1752: local
>> socket_directories
>> > stderr: ++ 17:14:12: pgsql_validate_all:1754: cat
>> /var/lib/pgsql/9.3/data//PG_VERSION
>> > stderr: + 17:14:12: pgsql_validate_all:1754: version=9.3
>> > stderr: + 17:14:12: pgsql_validate_all:1756: check_binary2
>> /usr/pgsql-9.3/bin/pg_ctl
>> > stderr: + 17:14:12: check_binary2:1724: have_binary
>> /usr/pgsql-9.3/bin/pg_ctl
>> > stderr: + 17:14:12: have_binary:68: '[' '' = 1 ']'
>> > stderr: ++ 17:14:12: have_binary:71: echo /usr/pgsql-9.3/bin/pg_ctl
>> > stderr: ++ 17:14:12: have_binary:71: sed -e 's/ -.*//'
>> > stderr: + 17:14:12: have_binary:71: local
>> bin=/usr/pgsql-9.3/bin/pg_ctl
>> > stderr: ++ 17:14:12: have_binary:72: which /usr/pgsql-9.3/bin/pg_ctl
>> > stderr: + 17:14:12: have_binary:72: test -x
>> /usr/pgsql-9.3/bin/pg_ctl
>> > stderr: + 17:14:12: check_binary2:1728: return 0
>> > stderr: + 17:14:12: pgsql_validate_all:1757: check_binary2
>> /usr/pgsql-9.3/bin/psql
>> > stderr: + 17:14:12: check_binary2:1724: have_binary
>> /usr/pgsql-9.3/bin/psql
>> > stderr: + 17:14:12: have_binary:68: '[' '' = 1 ']'
>> > stderr: ++ 17:14:12: have_binary:71: echo /usr/pgsql-9.3/bin/psql
>> > stderr: ++ 17:14:12: have_binary:71: sed -e 's/ -.*//'
>> > stderr: + 17:14:12: have_binary:71: local
>> bin=/usr/pgsql-9.3/bin/psql
>> > stderr: ++ 17:14:12: have_binary:72: which /usr/pgsql-9.3/bin/psql
>> > stderr: + 17:14:12: have_binary:72: test -x /usr/pgsql-9.3/bin/psql
>> > stderr: + 17:14:12: check_binary2:1728: return 0
>> > stderr: + 17:14:12: pgsql_validate_all:1761: check_config
>> /var/lib/pgsql/9.3/data//postgresql.conf
>> > stderr: + 17:14:12: check_config:1732: local rc=0
>> > stderr: + 17:14:12: check_config:1734: '[' '!' -f
>> /var/lib/pgsql/9.3/data//postgresql.conf ']'
>> > stderr: + 17:14:12: check_config:1744: return 0
>> > stderr: + 17:14:12: pgsql_validate_all:1762: check_config_rc=0
>> > stderr: + 17:14:12: pgsql_validate_all:1763: '[' 0 -eq 2 ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1764: '[' 0 -eq 0 ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1765: ocf_version_cmp 9.3 9.3
>> > stderr: + 17:14:12: ocf_version_cmp:543: ocf_is_ver 9.3
>> > stderr: + 17:14:12: ocf_is_ver:513: echo 9.3
>> > stderr: + 17:14:12: ocf_is_ver:513: grep '^[0-9][0-9.-]*[0-9]$'
>> > stderr: + 17:14:12: ocf_version_cmp:544: ocf_is_ver 9.3
>> > stderr: + 17:14:12: ocf_is_ver:513: grep '^[0-9][0-9.-]*[0-9]$'
>> > stderr: + 17:14:12: ocf_is_ver:513: echo 9.3
>> > stderr: + 17:14:12: ocf_version_cmp:545: local v1=9.3
>> > stderr: + 17:14:12: ocf_version_cmp:546: local v2=9.3
>> > stderr: ++ 17:14:12: ocf_version_cmp:547: ocf_ver_level 9.3
>> > stderr: ++ 17:14:12: ocf_ver_level:521: awk '-F[.-]' '{print NF}'
>> > stderr: ++ 17:14:12: ocf_ver_level:521: echo 9.3
>> > stderr: + 17:14:12: ocf_version_cmp:547: local v1_level=2
>> > stderr: ++ 17:14:12: ocf_version_cmp:548: ocf_ver_level 9.3
>> > stderr: ++ 17:14:12: ocf_ver_level:521: awk '-F[.-]' '{print NF}'
>> > stderr: ++ 17:14:12: ocf_ver_level:521: echo 9.3
>> > stderr: + 17:14:12: ocf_version_cmp:548: local v2_level=2
>> > stderr: + 17:14:12: ocf_version_cmp:549: local level_diff
>> > stderr: + 17:14:12: ocf_version_cmp:550: '[' 2 -lt 2 ']'
>> > stderr: + 17:14:12: ocf_version_cmp:553: '[' 2 -gt 2 ']'
>> > stderr: ++ 17:14:12: ocf_version_cmp:557: ocf_ver2num 9.3
>> > stderr: ++ 17:14:12: ocf_ver2num:516: awk '-F[.-]' '
>> > stderr: {for(i=1; i<=NF; i++) s=s*1000+$i; print s}
>> > stderr: '
>> > stderr: ++ 17:14:12: ocf_ver2num:516: echo 9.3
>> > stderr: + 17:14:12: ocf_version_cmp:557: v1=9003
>> > stderr: ++ 17:14:12: ocf_version_cmp:558: ocf_ver2num 9.3
>> > stderr: ++ 17:14:12: ocf_ver2num:516: echo 9.3
>> > stderr: ++ 17:14:12: ocf_ver2num:516: awk '-F[.-]' '
>> > stderr: {for(i=1; i<=NF; i++) s=s*1000+$i; print s}
>> > stderr: '
>> > stderr: + 17:14:12: ocf_version_cmp:558: v2=9003
>> > stderr: + 17:14:12: ocf_version_cmp:559: '[' 9003 -eq 9003 ']'
>> > stderr: + 17:14:12: ocf_version_cmp:560: return 1
>> > stderr: + 17:14:12: pgsql_validate_all:1766: '[' 1 -eq 0 ']'
>> > stderr: ++ 17:14:12: pgsql_validate_all:1770: get_pgsql_param
>> unix_socket_directories
>> > stderr: ++ 17:14:12: get_pgsql_param:32: local param_name
>> > stderr: ++ 17:14:12: get_pgsql_param:34:
>> param_name=unix_socket_directories
>> > stderr: ++ 17:14:12: get_pgsql_param:39: perl_code='if
>> (/^\s*unix_socket_directories[\s=]+\s*(.*)$/) {
>> > stderr: $dir=$1;
>> > stderr: $dir =~ s/\s*\#.*//;
>> > stderr: $dir =~ s/^'\''(\S*)'\''/$1/;
>> > stderr: print $dir;}'
>> > stderr: ++ 17:14:12: get_pgsql_param:41: perl -ne 'if
>> (/^\s*unix_socket_directories[\s=]+\s*(.*)$/) {
>> > stderr: $dir=$1;
>> > stderr: $dir =~ s/\s*\#.*//;
>> > stderr: $dir =~ s/^'\''(\S*)'\''/$1/;
>> > stderr: print $dir;}'
>> > stderr: + 17:14:12: pgsql_validate_all:1770: socket_directories=
>> > stderr: + 17:14:12: pgsql_validate_all:1771: '[' -n '' ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1782: getent passwd postgres
>> > stderr: + 17:14:12: pgsql_validate_all:1783: '[' '!' 0 -eq 0 ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1788: ocf_is_probe
>> > stderr: + 17:14:12: ocf_is_probe:490: '[' promote = monitor -a 0
>> = 0 ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1791: runasowner 'test -w
>> /var/lib/pgsql/9.3/data/'
>> > stderr: + 17:14:12: runasowner:467: local quietrun=
>> > stderr: + 17:14:12: runasowner:468: local loglevel=-err
>> > stderr: + 17:14:12: runasowner:469: local var
>> > stderr: + 17:14:12: runasowner:471: for var in 1 2
>> > stderr: + 17:14:12: runasowner:473: case "$1" in
>> > stderr: + 17:14:12: runasowner:471: for var in 1 2
>> > stderr: + 17:14:12: runasowner:473: case "$1" in
>> > stderr: + 17:14:12: runasowner:485: ocf_run -err runuser postgres
>> -c 'cd /var/lib/pgsql/9.3/data/; test -w /var/lib/pgsql/9.3/data/'
>> > stderr: + 17:14:12: ocf_run:413: local rc
>> > stderr: + 17:14:12: ocf_run:414: local output
>> > stderr: + 17:14:12: ocf_run:415: local verbose=1
>> > stderr: + 17:14:12: ocf_run:416: local loglevel=err
>> > stderr: + 17:14:12: ocf_run:417: local var
>> > stderr: + 17:14:12: ocf_run:419: for var in 1 2
>> > stderr: + 17:14:12: ocf_run:421: case "$1" in
>> > stderr: ++ 17:14:12: ocf_run:426: echo -err
>> > stderr: ++ 17:14:12: ocf_run:426: sed -e s/-//g
>> > stderr: + 17:14:12: ocf_run:426: loglevel=err
>> > stderr: + 17:14:12: ocf_run:427: shift 1
>> > stderr: + 17:14:12: ocf_run:419: for var in 1 2
>> > stderr: + 17:14:12: ocf_run:421: case "$1" in
>> > stderr: ++ 17:14:12: ocf_run:433: runuser postgres -c 'cd
>> /var/lib/pgsql/9.3/data/; test -w /var/lib/pgsql/9.3/data/'
>> > stderr: + 17:14:12: ocf_run:433: output=
>> > stderr: + 17:14:12: ocf_run:434: rc=0
>> > stderr: ++ 17:14:12: ocf_run:435: echo
>> > stderr: + 17:14:12: ocf_run:435: output=
>> > stderr: + 17:14:12: ocf_run:436: '[' 0 -eq 0 ']'
>> > stderr: + 17:14:12: ocf_run:437: '[' 1 -a '!' -z '' ']'
>> > stderr: + 17:14:12: ocf_run:440: return 0
>> > stderr: + 17:14:12: pgsql_validate_all:1797: '[' -n '' -a '!' -n
>> '' ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1803: '[' '!' -n '' -a -n
>> '' ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1809: is_replication
>> > stderr: + 17:14:12: is_replication:1287: '[' sync '!=' none -a
>> sync '!=' slave ']'
>> > stderr: + 17:14:12: is_replication:1288: return 0
>> > stderr: ++ 17:14:12: pgsql_validate_all:1810: printf '9.3\n9.1'
>> > stderr: ++ 17:14:12: pgsql_validate_all:1810: sort -n
>> > stderr: ++ 17:14:12: pgsql_validate_all:1810: head -1
>> > stderr: + 17:14:12: pgsql_validate_all:1810: '[' 9.1 '!=' 9.1 ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1814: '[' '!' -n
>> 10.200.200.233 ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1820: is_replication
>> > stderr: + 17:14:12: is_replication:1287: '[' sync '!=' none -a
>> sync '!=' slave ']'
>> > stderr: + 17:14:12: is_replication:1288: return 0
>> > stderr: + 17:14:12: pgsql_validate_all:1821: ocf_is_ms
>> > stderr: + 17:14:12: ocf_is_ms:504: '[' '!' -z 1 ']'
>> > stderr: + 17:14:12: ocf_is_ms:504: '[' 1 -gt 0 ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1825: '[' '!' sync = sync
>> -a '!' sync = async ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1829: '[' '!' -n 'pg1 pg2'
>> ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1833: '[' 0 -eq 0 ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1834:
>> rep_mode_string='include
>> '\''/var/lib/pgsql/9.3/tmp//rep_mode.conf'\'' # added by pgsql RA'
>> > stderr: + 17:14:12: pgsql_validate_all:1835: '[' sync = sync ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1836: grep -q 'include
>> '\''/var/lib/pgsql/9.3/tmp//rep_mode.conf'\'' # added by pgsql RA'
>> /var/lib/pgsql/9.3/data//postgresql.conf
>> > stderr: + 17:14:12: pgsql_validate_all:1848: mkdir -p
>> /var/lib/pgsql/9.3/tmp/
>> > stderr: + 17:14:12: pgsql_validate_all:1848: chown postgres
>> /var/lib/pgsql/9.3/tmp/
>> > stderr: + 17:14:12: pgsql_validate_all:1848: chmod 700
>> /var/lib/pgsql/9.3/tmp/
>> > stderr: + 17:14:12: pgsql_validate_all:1854: '[' sync = slave ']'
>> > stderr: + 17:14:12: pgsql_validate_all:1861: use_replication_slot
>> > stderr: + 17:14:12: use_replication_slot:1294: '[' -n '' ']'
>> > stderr: + 17:14:12: use_replication_slot:1298: return 1
>> > stderr: + 17:14:12: pgsql_validate_all:1869: return 0
>> > stderr: + 17:14:12: 1985: rc=0
>> > stderr: + 17:14:12: 1987: '[' promote = validate-all ']'
>> > stderr: + 17:14:12: 1989: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:12: 2002: id -u -n
>> > stderr: + 17:14:12: 2002: US=root
>> > stderr: + 17:14:12: 2004: '[' root '!=' root -a root '!='
>> postgres ']'
>> > stderr: + 17:14:12: 2011: '[' -n '' ']'
>> > stderr: + 17:14:12: 2016: psql_options='-p 5432 -U postgres
>> template1'
>> > stderr: + 17:14:12: 2019: '[' -n '' ']'
>> > stderr: + 17:14:12: 2022: '[' -n '' ']'
>> > stderr: + 17:14:12: 2027: '[' -n 5432 ']'
>> > stderr: + 17:14:12: 2028: export PGPORT=5432
>> > stderr: + 17:14:12: 2028: PGPORT=5432
>> > stderr: + 17:14:12: 2031: '[' -n /usr/lib ']'
>> > stderr: + 17:14:12: 2032: '[' -n '' ']'
>> > stderr: + 17:14:12: 2035: export LD_LIBRARY_PATH=/usr/lib
>> > stderr: + 17:14:12: 2035: LD_LIBRARY_PATH=/usr/lib
>> > stderr: + 17:14:12: 2041: case "$1" in
>> > stderr: + 17:14:12: 2057: pgsql_promote
>> > stderr: + 17:14:12: pgsql_promote:665: local target
>> > stderr: + 17:14:12: pgsql_promote:666: local rc
>> > stderr: + 17:14:12: pgsql_promote:668: is_replication
>> > stderr: + 17:14:12: is_replication:1287: '[' sync '!=' none -a
>> sync '!=' slave ']'
>> > stderr: + 17:14:12: is_replication:1288: return 0
>> > stderr: + 17:14:12: pgsql_promote:672: rm -f
>> '/var/lib/pgsql/9.3/tmp//xlog_note.*'
>> > stderr: + 17:14:12: pgsql_promote:674: for target in '$NODE_LIST'
>> > stderr: + 17:14:12: pgsql_promote:675: '[' pg1 = pm1 ']'
>> > stderr: + 17:14:12: pgsql_promote:676: change_data_status pg1
>> DISCONNECT
>> > stderr: + 17:14:12: change_data_status:1569: local output
>> > stderr: + 17:14:12: change_data_status:1571: node_exist pg1
>> > stderr: + 17:14:12: node_exist:1720: print_crm_mon
>> > stderr: + 17:14:12: node_exist:1720: tr '[A-Z]' '[a-z]'
>> > stderr: + 17:14:12: node_exist:1720: grep -q '^node pg1'
>> > stderr: + 17:14:12: print_crm_mon:1924: '[' -z '' ']'
>> > stderr: ++ 17:14:12: print_crm_mon:1925: exec_with_retry 0
>> crm_mon -n1
>> > stderr: ++ 17:14:12: exec_with_retry:1689: local count=86400
>> > stderr: ++ 17:14:12: exec_with_retry:1690: local output
>> > stderr: ++ 17:14:12: exec_with_retry:1691: local rc
>> > stderr: ++ 17:14:12: exec_with_retry:1693: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:12: exec_with_retry:1696: shift
>> > stderr: ++ 17:14:12: exec_with_retry:1698: '[' 86400 -gt 0 ']'
>> > stderr: +++ 17:14:12: exec_with_retry:1699: crm_mon -n1
>> > stderr: ++ 17:14:12: exec_with_retry:1699: output='Last updated:
>> Mon Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56 2015
>> by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: ++ 17:14:12: exec_with_retry:1700: rc=0
>> > stderr: ++ 17:14:12: exec_with_retry:1701: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:12: exec_with_retry:1706: printf 'Last updated:
>> Mon Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56 2015
>> by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: ++ 17:14:12: exec_with_retry:1707: return 0
>> > stderr: + 17:14:12: print_crm_mon:1925: CRM_MON_OUTPUT='Last
>> updated: Mon Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56
>> 2015 by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: + 17:14:12: print_crm_mon:1927: printf 'Last updated: Mon
>> Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56 2015 by
>> root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave\n'
>> > stderr: + 17:14:12: change_data_status:1572: return 0
>> > stderr: + 17:14:12: pgsql_promote:677: change_master_score pg1
>> -INFINITY
>> > stderr: + 17:14:12: change_master_score:1604: local instance
>> > stderr: + 17:14:12: change_master_score:1606: is_node_online pg1
>> > stderr: + 17:14:12: is_node_online:1716: print_crm_mon
>> > stderr: + 17:14:12: is_node_online:1716: tr '[A-Z]' '[a-z]'
>> > stderr: + 17:14:12: is_node_online:1716: grep -e '^node pg1 ' -e
>> '^node pg1:'
>> > stderr: + 17:14:12: is_node_online:1716: grep -q -v offline
>> > stderr: + 17:14:12: print_crm_mon:1924: '[' -z '' ']'
>> > stderr: ++ 17:14:12: print_crm_mon:1925: exec_with_retry 0
>> crm_mon -n1
>> > stderr: ++ 17:14:12: exec_with_retry:1689: local count=86400
>> > stderr: ++ 17:14:12: exec_with_retry:1690: local output
>> > stderr: ++ 17:14:12: exec_with_retry:1691: local rc
>> > stderr: ++ 17:14:12: exec_with_retry:1693: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:12: exec_with_retry:1696: shift
>> > stderr: ++ 17:14:12: exec_with_retry:1698: '[' 86400 -gt 0 ']'
>> > stderr: +++ 17:14:12: exec_with_retry:1699: crm_mon -n1
>> > stderr: ++ 17:14:12: exec_with_retry:1699: output='Last updated:
>> Mon Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56 2015
>> by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: ++ 17:14:12: exec_with_retry:1700: rc=0
>> > stderr: ++ 17:14:12: exec_with_retry:1701: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:12: exec_with_retry:1706: printf 'Last updated:
>> Mon Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56 2015
>> by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: ++ 17:14:12: exec_with_retry:1707: return 0
>> > stderr: + 17:14:12: print_crm_mon:1925: CRM_MON_OUTPUT='Last
>> updated: Mon Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56
>> 2015 by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: + 17:14:12: print_crm_mon:1927: printf 'Last updated: Mon
>> Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56 2015 by
>> root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave\n'
>> > stderr: + 17:14:12: change_master_score:1607: return 0
>> > stderr: + 17:14:12: pgsql_promote:674: for target in '$NODE_LIST'
>> > stderr: + 17:14:12: pgsql_promote:675: '[' pg2 = pm1 ']'
>> > stderr: + 17:14:12: pgsql_promote:676: change_data_status pg2
>> DISCONNECT
>> > stderr: + 17:14:12: change_data_status:1569: local output
>> > stderr: + 17:14:12: change_data_status:1571: node_exist pg2
>> > stderr: + 17:14:12: node_exist:1720: print_crm_mon
>> > stderr: + 17:14:12: node_exist:1720: tr '[A-Z]' '[a-z]'
>> > stderr: + 17:14:12: node_exist:1720: grep -q '^node pg2'
>> > stderr: + 17:14:12: print_crm_mon:1924: '[' -z '' ']'
>> > stderr: ++ 17:14:12: print_crm_mon:1925: exec_with_retry 0
>> crm_mon -n1
>> > stderr: ++ 17:14:12: exec_with_retry:1689: local count=86400
>> > stderr: ++ 17:14:12: exec_with_retry:1690: local output
>> > stderr: ++ 17:14:12: exec_with_retry:1691: local rc
>> > stderr: ++ 17:14:12: exec_with_retry:1693: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:12: exec_with_retry:1696: shift
>> > stderr: ++ 17:14:12: exec_with_retry:1698: '[' 86400 -gt 0 ']'
>> > stderr: +++ 17:14:12: exec_with_retry:1699: crm_mon -n1
>> > stderr: ++ 17:14:12: exec_with_retry:1699: output='Last updated:
>> Mon Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56 2015
>> by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: ++ 17:14:12: exec_with_retry:1700: rc=0
>> > stderr: ++ 17:14:12: exec_with_retry:1701: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:12: exec_with_retry:1706: printf 'Last updated:
>> Mon Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56 2015
>> by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: ++ 17:14:12: exec_with_retry:1707: return 0
>> > stderr: + 17:14:12: print_crm_mon:1925: CRM_MON_OUTPUT='Last
>> updated: Mon Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56
>> 2015 by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: + 17:14:12: print_crm_mon:1927: printf 'Last updated: Mon
>> Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56 2015 by
>> root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave\n'
>> > stderr: + 17:14:12: change_data_status:1572: return 0
>> > stderr: + 17:14:12: pgsql_promote:677: change_master_score pg2
>> -INFINITY
>> > stderr: + 17:14:12: change_master_score:1604: local instance
>> > stderr: + 17:14:12: change_master_score:1606: is_node_online pg2
>> > stderr: + 17:14:12: is_node_online:1716: grep -q -v offline
>> > stderr: + 17:14:12: is_node_online:1716: print_crm_mon
>> > stderr: + 17:14:12: is_node_online:1716: tr '[A-Z]' '[a-z]'
>> > stderr: + 17:14:12: is_node_online:1716: grep -e '^node pg2 ' -e
>> '^node pg2:'
>> > stderr: + 17:14:12: print_crm_mon:1924: '[' -z '' ']'
>> > stderr: ++ 17:14:12: print_crm_mon:1925: exec_with_retry 0
>> crm_mon -n1
>> > stderr: ++ 17:14:12: exec_with_retry:1689: local count=86400
>> > stderr: ++ 17:14:12: exec_with_retry:1690: local output
>> > stderr: ++ 17:14:12: exec_with_retry:1691: local rc
>> > stderr: ++ 17:14:12: exec_with_retry:1693: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:12: exec_with_retry:1696: shift
>> > stderr: ++ 17:14:12: exec_with_retry:1698: '[' 86400 -gt 0 ']'
>> > stderr: +++ 17:14:12: exec_with_retry:1699: crm_mon -n1
>> > stderr: ++ 17:14:12: exec_with_retry:1699: output='Last updated:
>> Mon Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56 2015
>> by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: ++ 17:14:12: exec_with_retry:1700: rc=0
>> > stderr: ++ 17:14:12: exec_with_retry:1701: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:12: exec_with_retry:1706: printf 'Last updated:
>> Mon Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56 2015
>> by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: ++ 17:14:12: exec_with_retry:1707: return 0
>> > stderr: + 17:14:12: print_crm_mon:1925: CRM_MON_OUTPUT='Last
>> updated: Mon Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56
>> 2015 by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: + 17:14:12: print_crm_mon:1927: printf 'Last updated: Mon
>> Oct 12 17:14:12 2015 Last change: Mon Oct 12 16:07:56 2015 by
>> root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave\n'
>> > stderr: + 17:14:12: change_master_score:1607: return 0
>> > stderr: + 17:14:12: pgsql_promote:680: ocf_log info 'Creating
>> /var/lib/pgsql/9.3/tmp//PGSQL.lock.'
>> > stderr: + 17:14:12: ocf_log:321: '[' 2 -lt 2 ']'
>> > stderr: + 17:14:12: ocf_log:325: __OCF_PRIO=info
>> > stderr: + 17:14:12: ocf_log:326: shift
>> > stderr: + 17:14:12: ocf_log:327: __OCF_MSG='Creating
>> /var/lib/pgsql/9.3/tmp//PGSQL.lock.'
>> > stderr: + 17:14:12: ocf_log:329: case "${__OCF_PRIO}" in
>> > stderr: + 17:14:12: ocf_log:333: __OCF_PRIO=INFO
>> > stderr: + 17:14:12: ocf_log:338: '[' INFO = DEBUG ']'
>> > stderr: + 17:14:12: ocf_log:341: ha_log 'INFO: Creating
>> /var/lib/pgsql/9.3/tmp//PGSQL.lock.'
>> > stderr: + 17:14:12: ha_log:253: __ha_log 'INFO: Creating
>> /var/lib/pgsql/9.3/tmp//PGSQL.lock.'
>> > stderr: + 17:14:12: __ha_log:185: local ignore_stderr=false
>> > stderr: + 17:14:12: __ha_log:186: local loglevel
>> > stderr: + 17:14:12: __ha_log:188: '[' 'xINFO: Creating
>> /var/lib/pgsql/9.3/tmp//PGSQL.lock.' = x--ignore-stderr ']'
>> > stderr: + 17:14:12: __ha_log:190: '[' none = '' ']'
>> > stderr: + 17:14:12: __ha_log:192: tty
>> > stderr: + 17:14:12: __ha_log:193: '[' x = x0 -a x = xdebug ']'
>> > stderr: + 17:14:12: __ha_log:195: '[' false = true ']'
>> > stderr: + 17:14:12: __ha_log:199: '[' '' ']'
>> > stderr: + 17:14:12: __ha_log:202: echo 'INFO: Creating
>> /var/lib/pgsql/9.3/tmp//PGSQL.lock.'
>> > stderr: INFO: Creating /var/lib/pgsql/9.3/tmp//PGSQL.lock.
>> > stderr: + 17:14:12: __ha_log:204: return 0
>> > stderr: + 17:14:12: pgsql_promote:681: touch
>> /var/lib/pgsql/9.3/tmp//PGSQL.lock
>> > stderr: + 17:14:12: pgsql_promote:682: show_master_baseline
>> > stderr: + 17:14:12: show_master_baseline:1438: local rc
>> > stderr: + 17:14:12: show_master_baseline:1439: local location
>> > stderr: ++ 17:14:12: show_master_baseline:1441: get_my_location
>> > stderr: ++ 17:14:12: get_my_location:1389: local rc
>> > stderr: ++ 17:14:12: get_my_location:1390: local output
>> > stderr: ++ 17:14:12: get_my_location:1391: local replay_loc
>> > stderr: ++ 17:14:12: get_my_location:1392: local receive_loc
>> > stderr: ++ 17:14:12: get_my_location:1393: local output1
>> > stderr: ++ 17:14:12: get_my_location:1394: local output2
>> > stderr: ++ 17:14:12: get_my_location:1395: local log1
>> > stderr: ++ 17:14:12: get_my_location:1396: local log2
>> > stderr: ++ 17:14:12: get_my_location:1397: local newer_location
>> > stderr: +++ 17:14:12: get_my_location:1399: exec_sql ''
>> > stderr: +++ 17:14:12: exec_sql:518: local sql=
>> > stderr: +++ 17:14:12: exec_sql:519: local output
>> > stderr: +++ 17:14:12: exec_sql:520: local rc
>> > stderr: ++++ 17:14:12: exec_sql:524: runuser postgres -c 'cd
>> /var/lib/pgsql/9.3/data/; /usr/pgsql-9.3/bin/psql -p 5432 -U postgres
>> template1 -U postgres -Atc ""'
>> > stderr: +++ 17:14:12: exec_sql:524: output=
>> > stderr: +++ 17:14:12: exec_sql:525: rc=0
>> > stderr: +++ 17:14:12: exec_sql:527: echo
>> > stderr: +++ 17:14:12: exec_sql:528: return 0
>> > stderr: ++ 17:14:12: get_my_location:1399: output=
>> > stderr: ++ 17:14:12: get_my_location:1400: rc=0
>> > stderr: ++ 17:14:12: get_my_location:1402: '[' 0 -ne 0 ']'
>> > stderr: +++ 17:14:12: get_my_location:1406: cut -d '|' -f 1
>> > stderr: +++ 17:14:12: get_my_location:1406: echo
>> > stderr: ++ 17:14:12: get_my_location:1406: replay_loc=
>> > stderr: +++ 17:14:12: get_my_location:1407: cut -d '|' -f 2
>> > stderr: +++ 17:14:12: get_my_location:1407: echo
>> > stderr: ++ 17:14:12: get_my_location:1407: receive_loc=
>> > stderr: +++ 17:14:12: get_my_location:1409: echo ''
>> > stderr: +++ 17:14:12: get_my_location:1409: cut -d / -f 1
>> > stderr: ++ 17:14:12: get_my_location:1409: output1=
>> > stderr: +++ 17:14:12: get_my_location:1410: echo ''
>> > stderr: +++ 17:14:12: get_my_location:1410: cut -d / -f 2
>> > stderr: ++ 17:14:12: get_my_location:1410: output2=
>> > stderr: +++ 17:14:12: get_my_location:1411: printf '%08s\n'
>> > stderr: +++ 17:14:12: get_my_location:1411: sed 's/ /0/g'
>> > stderr: ++ 17:14:12: get_my_location:1411: log1=00000000
>> > stderr: +++ 17:14:12: get_my_location:1412: printf '%08s\n'
>> > stderr: +++ 17:14:12: get_my_location:1412: sed 's/ /0/g'
>> > stderr: ++ 17:14:12: get_my_location:1412: log2=00000000
>> > stderr: ++ 17:14:12: get_my_location:1413:
>> replay_loc=0000000000000000
>> > stderr: +++ 17:14:12: get_my_location:1415: cut -d / -f 1
>> > stderr: +++ 17:14:12: get_my_location:1415: echo ''
>> > stderr: ++ 17:14:12: get_my_location:1415: output1=
>> > stderr: +++ 17:14:12: get_my_location:1416: cut -d / -f 2
>> > stderr: +++ 17:14:12: get_my_location:1416: echo ''
>> > stderr: ++ 17:14:12: get_my_location:1416: output2=
>> > stderr: +++ 17:14:12: get_my_location:1417: sed 's/ /0/g'
>> > stderr: +++ 17:14:12: get_my_location:1417: printf '%08s\n'
>> > stderr: ++ 17:14:12: get_my_location:1417: log1=00000000
>> > stderr: +++ 17:14:12: get_my_location:1418: sed 's/ /0/g'
>> > stderr: +++ 17:14:12: get_my_location:1418: printf '%08s\n'
>> > stderr: ++ 17:14:12: get_my_location:1418: log2=00000000
>> > stderr: ++ 17:14:12: get_my_location:1419:
>> receive_loc=0000000000000000
>> > stderr: +++ 17:14:12: get_my_location:1421: printf
>> '0000000000000000\n0000000000000000'
>> > stderr: +++ 17:14:12: get_my_location:1421: sort -r
>> > stderr: +++ 17:14:12: get_my_location:1421: head -1
>> > stderr: ++ 17:14:12: get_my_location:1421:
>> newer_location=0000000000000000
>> > stderr: ++ 17:14:12: get_my_location:1422: echo 0000000000000000
>> > stderr: ++ 17:14:12: get_my_location:1423: return 0
>> > stderr: + 17:14:12: show_master_baseline:1441:
>> location=0000000000000000
>> > stderr: + 17:14:12: show_master_baseline:1442: ocf_log info 'My
>> master baseline : 0000000000000000.'
>> > stderr: + 17:14:12: ocf_log:321: '[' 2 -lt 2 ']'
>> > stderr: + 17:14:12: ocf_log:325: __OCF_PRIO=info
>> > stderr: + 17:14:12: ocf_log:326: shift
>> > stderr: + 17:14:12: ocf_log:327: __OCF_MSG='My master baseline :
>> 0000000000000000.'
>> > stderr: + 17:14:12: ocf_log:329: case "${__OCF_PRIO}" in
>> > stderr: + 17:14:12: ocf_log:333: __OCF_PRIO=INFO
>> > stderr: + 17:14:12: ocf_log:338: '[' INFO = DEBUG ']'
>> > stderr: + 17:14:12: ocf_log:341: ha_log 'INFO: My master baseline
>> : 0000000000000000.'
>> > stderr: + 17:14:12: ha_log:253: __ha_log 'INFO: My master
>> baseline : 0000000000000000.'
>> > stderr: + 17:14:12: __ha_log:185: local ignore_stderr=false
>> > stderr: + 17:14:12: __ha_log:186: local loglevel
>> > stderr: + 17:14:12: __ha_log:188: '[' 'xINFO: My master baseline
>> : 0000000000000000.' = x--ignore-stderr ']'
>> > stderr: + 17:14:12: __ha_log:190: '[' none = '' ']'
>> > stderr: + 17:14:12: __ha_log:192: tty
>> > stderr: + 17:14:12: __ha_log:193: '[' x = x0 -a x = xdebug ']'
>> > stderr: + 17:14:12: __ha_log:195: '[' false = true ']'
>> > stderr: + 17:14:12: __ha_log:199: '[' '' ']'
>> > stderr: + 17:14:12: __ha_log:202: echo 'INFO: My master baseline
>> : 0000000000000000.'
>> > stderr: INFO: My master baseline : 0000000000000000.
>> > stderr: + 17:14:12: __ha_log:204: return 0
>> > stderr: + 17:14:12: show_master_baseline:1443: exec_with_retry 0
>> /usr/sbin/crm_attribute -l reboot -N pm1 -n pgsql-master-baseline -v
>> 0000000000000000
>> > stderr: + 17:14:12: exec_with_retry:1689: local count=86400
>> > stderr: + 17:14:12: exec_with_retry:1690: local output
>> > stderr: + 17:14:12: exec_with_retry:1691: local rc
>> > stderr: + 17:14:12: exec_with_retry:1693: '[' 0 -ne 0 ']'
>> > stderr: + 17:14:12: exec_with_retry:1696: shift
>> > stderr: + 17:14:12: exec_with_retry:1698: '[' 86400 -gt 0 ']'
>> > stderr: ++ 17:14:12: exec_with_retry:1699:
>> /usr/sbin/crm_attribute -l reboot -N pm1 -n pgsql-master-baseline -v
>> 0000000000000000
>> > stderr: + 17:14:12: exec_with_retry:1699: output=
>> > stderr: + 17:14:12: exec_with_retry:1700: rc=0
>> > stderr: + 17:14:12: exec_with_retry:1701: '[' 0 -ne 0 ']'
>> > stderr: + 17:14:12: exec_with_retry:1706: printf ''
>> > stderr: + 17:14:12: exec_with_retry:1707: return 0
>> > stderr: + 17:14:12: pgsql_promote:684: ocf_is_true true
>> > stderr: + 17:14:12: ocf_is_true:101: case "$1" in
>> > stderr: + 17:14:12: ocf_is_true:102: true
>> > stderr: + 17:14:12: pgsql_promote:685: ocf_log info 'Restarting
>> PostgreSQL instead of promote.'
>> > stderr: + 17:14:12: ocf_log:321: '[' 2 -lt 2 ']'
>> > stderr: + 17:14:12: ocf_log:325: __OCF_PRIO=info
>> > stderr: + 17:14:12: ocf_log:326: shift
>> > stderr: + 17:14:12: ocf_log:327: __OCF_MSG='Restarting PostgreSQL
>> instead of promote.'
>> > stderr: + 17:14:12: ocf_log:329: case "${__OCF_PRIO}" in
>> > stderr: + 17:14:12: ocf_log:333: __OCF_PRIO=INFO
>> > stderr: + 17:14:12: ocf_log:338: '[' INFO = DEBUG ']'
>> > stderr: + 17:14:12: ocf_log:341: ha_log 'INFO: Restarting
>> PostgreSQL instead of promote.'
>> > stderr: + 17:14:12: ha_log:253: __ha_log 'INFO: Restarting
>> PostgreSQL instead of promote.'
>> > stderr: + 17:14:12: __ha_log:185: local ignore_stderr=false
>> > stderr: + 17:14:12: __ha_log:186: local loglevel
>> > stderr: + 17:14:12: __ha_log:188: '[' 'xINFO: Restarting
>> PostgreSQL instead of promote.' = x--ignore-stderr ']'
>> > stderr: + 17:14:12: __ha_log:190: '[' none = '' ']'
>> > stderr: + 17:14:12: __ha_log:192: tty
>> > stderr: + 17:14:12: __ha_log:193: '[' x = x0 -a x = xdebug ']'
>> > stderr: + 17:14:12: __ha_log:195: '[' false = true ']'
>> > stderr: + 17:14:12: __ha_log:199: '[' '' ']'
>> > stderr: + 17:14:12: __ha_log:202: echo 'INFO: Restarting
>> PostgreSQL instead of promote.'
>> > stderr: INFO: Restarting PostgreSQL instead of promote.
>> > stderr: + 17:14:12: __ha_log:204: return 0
>> > stderr: + 17:14:12: pgsql_promote:687: pgsql_real_stop slave
>> > stderr: + 17:14:12: pgsql_real_stop:758: local rc
>> > stderr: + 17:14:12: pgsql_real_stop:759: local count
>> > stderr: + 17:14:12: pgsql_real_stop:760: local stop_escalate
>> > stderr: + 17:14:12: pgsql_real_stop:762: ocf_is_true false
>> > stderr: + 17:14:12: ocf_is_true:101: case "$1" in
>> > stderr: + 17:14:12: ocf_is_true:103: false
>> > stderr: + 17:14:12: pgsql_real_stop:766: pgsql_status
>> > stderr: + 17:14:12: pgsql_status:866: '[' -f
>> /var/lib/pgsql/9.3/data//postmaster.pid ']'
>> > stderr: ++ 17:14:12: pgsql_status:868: head -n 1
>> /var/lib/pgsql/9.3/data//postmaster.pid
>> > stderr: + 17:14:12: pgsql_status:868: PID=6046
>> > stderr: + 17:14:12: pgsql_status:869: runasowner 'kill -s 0 6046
>> >/dev/null 2>&1'
>> > stderr: + 17:14:12: runasowner:467: local quietrun=
>> > stderr: + 17:14:12: runasowner:468: local loglevel=-err
>> > stderr: + 17:14:12: runasowner:469: local var
>> > stderr: + 17:14:12: runasowner:471: for var in 1 2
>> > stderr: + 17:14:12: runasowner:473: case "$1" in
>> > stderr: + 17:14:12: runasowner:471: for var in 1 2
>> > stderr: + 17:14:12: runasowner:473: case "$1" in
>> > stderr: + 17:14:12: runasowner:485: ocf_run -err runuser postgres
>> -c 'cd /var/lib/pgsql/9.3/data/; kill -s 0 6046 >/dev/null 2>&1'
>> > stderr: + 17:14:12: ocf_run:413: local rc
>> > stderr: + 17:14:12: ocf_run:414: local output
>> > stderr: + 17:14:12: ocf_run:415: local verbose=1
>> > stderr: + 17:14:12: ocf_run:416: local loglevel=err
>> > stderr: + 17:14:12: ocf_run:417: local var
>> > stderr: + 17:14:12: ocf_run:419: for var in 1 2
>> > stderr: + 17:14:12: ocf_run:421: case "$1" in
>> > stderr: ++ 17:14:12: ocf_run:426: echo -err
>> > stderr: ++ 17:14:12: ocf_run:426: sed -e s/-//g
>> > stderr: + 17:14:12: ocf_run:426: loglevel=err
>> > stderr: + 17:14:12: ocf_run:427: shift 1
>> > stderr: + 17:14:12: ocf_run:419: for var in 1 2
>> > stderr: + 17:14:12: ocf_run:421: case "$1" in
>> > stderr: ++ 17:14:12: ocf_run:433: runuser postgres -c 'cd
>> /var/lib/pgsql/9.3/data/; kill -s 0 6046 >/dev/null 2>&1'
>> > stderr: + 17:14:12: ocf_run:433: output=
>> > stderr: + 17:14:12: ocf_run:434: rc=0
>> > stderr: ++ 17:14:12: ocf_run:435: echo
>> > stderr: + 17:14:12: ocf_run:435: output=
>> > stderr: + 17:14:12: ocf_run:436: '[' 0 -eq 0 ']'
>> > stderr: + 17:14:12: ocf_run:437: '[' 1 -a '!' -z '' ']'
>> > stderr: + 17:14:12: ocf_run:440: return 0
>> > stderr: + 17:14:12: pgsql_status:870: return 0
>> > stderr: + 17:14:12: pgsql_real_stop:772: stop_escalate=30
>> > stderr: + 17:14:12: pgsql_real_stop:773: '[' slave = slave ']'
>> > stderr: + 17:14:12: pgsql_real_stop:774: stop_escalate=30
>> > stderr: + 17:14:12: pgsql_real_stop:778: '[' 30 -gt 0 ']'
>> > stderr: + 17:14:12: pgsql_real_stop:779: runasowner
>> '/usr/pgsql-9.3/bin/pg_ctl -D /var/lib/pgsql/9.3/data/ stop -m fast'
>> > stderr: + 17:14:12: runasowner:467: local quietrun=
>> > stderr: + 17:14:12: runasowner:468: local loglevel=-err
>> > stderr: + 17:14:12: runasowner:469: local var
>> > stderr: + 17:14:12: runasowner:471: for var in 1 2
>> > stderr: + 17:14:12: runasowner:473: case "$1" in
>> > stderr: + 17:14:12: runasowner:471: for var in 1 2
>> > stderr: + 17:14:12: runasowner:473: case "$1" in
>> > stderr: + 17:14:12: runasowner:485: ocf_run -err runuser postgres
>> -c 'cd /var/lib/pgsql/9.3/data/; /usr/pgsql-9.3/bin/pg_ctl -D
>> /var/lib/pgsql/9.3/data/ stop -m fast'
>> > stderr: + 17:14:12: ocf_run:413: local rc
>> > stderr: + 17:14:12: ocf_run:414: local output
>> > stderr: + 17:14:12: ocf_run:415: local verbose=1
>> > stderr: + 17:14:12: ocf_run:416: local loglevel=err
>> > stderr: + 17:14:12: ocf_run:417: local var
>> > stderr: + 17:14:12: ocf_run:419: for var in 1 2
>> > stderr: + 17:14:12: ocf_run:421: case "$1" in
>> > stderr: ++ 17:14:12: ocf_run:426: echo -err
>> > stderr: ++ 17:14:12: ocf_run:426: sed -e s/-//g
>> > stderr: + 17:14:12: ocf_run:426: loglevel=err
>> > stderr: + 17:14:12: ocf_run:427: shift 1
>> > stderr: + 17:14:12: ocf_run:419: for var in 1 2
>> > stderr: + 17:14:12: ocf_run:421: case "$1" in
>> > stderr: ++ 17:14:12: ocf_run:433: runuser postgres -c 'cd
>> /var/lib/pgsql/9.3/data/; /usr/pgsql-9.3/bin/pg_ctl -D
>> /var/lib/pgsql/9.3/data/ stop -m fast'
>> > stderr: + 17:14:13: ocf_run:433: output='waiting for server to
>> shut down.... done
>> > stderr: server stopped'
>> > stderr: + 17:14:13: ocf_run:434: rc=0
>> > stderr: ++ 17:14:13: ocf_run:435: echo waiting for server to shut
>> down.... done server stopped
>> > stderr: + 17:14:13: ocf_run:435: output='waiting for server to
>> shut down.... done server stopped'
>> > stderr: + 17:14:13: ocf_run:436: '[' 0 -eq 0 ']'
>> > stderr: + 17:14:13: ocf_run:437: '[' 1 -a '!' -z 'waiting for
>> server to shut down.... done server stopped' ']'
>> > stderr: + 17:14:13: ocf_run:438: ocf_log info 'waiting for server
>> to shut down.... done server stopped'
>> > stderr: + 17:14:13: ocf_log:321: '[' 2 -lt 2 ']'
>> > stderr: + 17:14:13: ocf_log:325: __OCF_PRIO=info
>> > stderr: + 17:14:13: ocf_log:326: shift
>> > stderr: + 17:14:13: ocf_log:327: __OCF_MSG='waiting for server to
>> shut down.... done server stopped'
>> > stderr: + 17:14:13: ocf_log:329: case "${__OCF_PRIO}" in
>> > stderr: + 17:14:13: ocf_log:333: __OCF_PRIO=INFO
>> > stderr: + 17:14:13: ocf_log:338: '[' INFO = DEBUG ']'
>> > stderr: + 17:14:13: ocf_log:341: ha_log 'INFO: waiting for server
>> to shut down.... done server stopped'
>> > stderr: + 17:14:13: ha_log:253: __ha_log 'INFO: waiting for
>> server to shut down.... done server stopped'
>> > stderr: + 17:14:13: __ha_log:185: local ignore_stderr=false
>> > stderr: + 17:14:13: __ha_log:186: local loglevel
>> > stderr: + 17:14:13: __ha_log:188: '[' 'xINFO: waiting for server
>> to shut down.... done server stopped' = x--ignore-stderr ']'
>> > stderr: + 17:14:13: __ha_log:190: '[' none = '' ']'
>> > stderr: + 17:14:13: __ha_log:192: tty
>> > stderr: + 17:14:13: __ha_log:193: '[' x = x0 -a x = xdebug ']'
>> > stderr: + 17:14:13: __ha_log:195: '[' false = true ']'
>> > stderr: + 17:14:13: __ha_log:199: '[' '' ']'
>> > stderr: + 17:14:13: __ha_log:202: echo 'INFO: waiting for server
>> to shut down.... done server stopped'
>> > stderr: INFO: waiting for server to shut down.... done server
>> stopped
>> > stderr: + 17:14:13: __ha_log:204: return 0
>> > stderr: + 17:14:13: ocf_run:440: return 0
>> > stderr: + 17:14:13: pgsql_real_stop:783: count=0
>> > stderr: + 17:14:13: pgsql_real_stop:784: '[' 0 -lt 30 ']'
>> > stderr: + 17:14:13: pgsql_real_stop:786: pgsql_status
>> > stderr: + 17:14:13: pgsql_status:866: '[' -f
>> /var/lib/pgsql/9.3/data//postmaster.pid ']'
>> > stderr: + 17:14:13: pgsql_status:874: false
>> > stderr: + 17:14:13: pgsql_real_stop:789: break
>> > stderr: + 17:14:13: pgsql_real_stop:795: pgsql_status
>> > stderr: + 17:14:13: pgsql_status:866: '[' -f
>> /var/lib/pgsql/9.3/data//postmaster.pid ']'
>> > stderr: + 17:14:13: pgsql_status:874: false
>> > stderr: + 17:14:13: pgsql_real_stop:802: :
>> > stderr: + 17:14:13: pgsql_real_stop:804: pgsql_real_monitor
>> > stderr: + 17:14:13: pgsql_real_monitor:905: local loglevel
>> > stderr: + 17:14:13: pgsql_real_monitor:906: local rc
>> > stderr: + 17:14:13: pgsql_real_monitor:907: local output
>> > stderr: + 17:14:13: pgsql_real_monitor:910: loglevel=err
>> > stderr: + 17:14:13: pgsql_real_monitor:912: pgsql_status
>> > stderr: + 17:14:13: pgsql_status:866: '[' -f
>> /var/lib/pgsql/9.3/data//postmaster.pid ']'
>> > stderr: + 17:14:13: pgsql_status:874: false
>> > stderr: + 17:14:13: pgsql_real_monitor:914: ocf_log info
>> 'PostgreSQL is down'
>> > stderr: + 17:14:13: ocf_log:321: '[' 2 -lt 2 ']'
>> > stderr: + 17:14:13: ocf_log:325: __OCF_PRIO=info
>> > stderr: + 17:14:13: ocf_log:326: shift
>> > stderr: + 17:14:13: ocf_log:327: __OCF_MSG='PostgreSQL is down'
>> > stderr: + 17:14:13: ocf_log:329: case "${__OCF_PRIO}" in
>> > stderr: + 17:14:13: ocf_log:333: __OCF_PRIO=INFO
>> > stderr: + 17:14:13: ocf_log:338: '[' INFO = DEBUG ']'
>> > stderr: + 17:14:13: ocf_log:341: ha_log 'INFO: PostgreSQL is down'
>> > stderr: + 17:14:13: ha_log:253: __ha_log 'INFO: PostgreSQL is down'
>> > stderr: + 17:14:13: __ha_log:185: local ignore_stderr=false
>> > stderr: + 17:14:13: __ha_log:186: local loglevel
>> > stderr: + 17:14:13: __ha_log:188: '[' 'xINFO: PostgreSQL is down'
>> = x--ignore-stderr ']'
>> > stderr: + 17:14:13: __ha_log:190: '[' none = '' ']'
>> > stderr: + 17:14:13: __ha_log:192: tty
>> > stderr: + 17:14:13: __ha_log:193: '[' x = x0 -a x = xdebug ']'
>> > stderr: + 17:14:13: __ha_log:195: '[' false = true ']'
>> > stderr: + 17:14:13: __ha_log:199: '[' '' ']'
>> > stderr: + 17:14:13: __ha_log:202: echo 'INFO: PostgreSQL is down'
>> > stderr: INFO: PostgreSQL is down
>> > stderr: + 17:14:13: __ha_log:204: return 0
>> > stderr: + 17:14:13: pgsql_real_monitor:915: return 7
>> > stderr: + 17:14:13: pgsql_real_stop:805: rc=7
>> > stderr: + 17:14:13: pgsql_real_stop:806: '[' 7 -eq 7 ']'
>> > stderr: + 17:14:13: pgsql_real_stop:808: break
>> > stderr: + 17:14:13: pgsql_real_stop:815: rm -f
>> /var/lib/pgsql/9.3/data//postmaster.pid
>> > stderr: + 17:14:13: pgsql_real_stop:817: '[' slave = master -a ''
>> = ' ' ']'
>> > stderr: + 17:14:13: pgsql_real_stop:821: return 0
>> > stderr: + 17:14:13: pgsql_promote:688: rm -f
>> /var/lib/pgsql/9.3/data//recovery.conf
>> > stderr: + 17:14:13: pgsql_promote:689: pgsql_real_start
>> > stderr: + 17:14:13: pgsql_real_start:534: local pgctl_options
>> > stderr: + 17:14:13: pgsql_real_start:535: local postgres_options
>> > stderr: + 17:14:13: pgsql_real_start:536: local rc
>> > stderr: + 17:14:13: pgsql_real_start:538: pgsql_status
>> > stderr: + 17:14:13: pgsql_status:866: '[' -f
>> /var/lib/pgsql/9.3/data//postmaster.pid ']'
>> > stderr: + 17:14:13: pgsql_status:874: false
>> > stderr: + 17:14:13: pgsql_real_start:548: rm -f
>> /var/lib/pgsql/9.3/data//postmaster.pid
>> > stderr: + 17:14:13: pgsql_real_start:551: '[' -f
>> /var/lib/pgsql/9.3/data//backup_label ']'
>> > stderr: + 17:14:13: pgsql_real_start:557: check_log_file /dev/null
>> > stderr: + 17:14:13: check_log_file:1878: '[' '!' -f /dev/null ']'
>> > stderr: + 17:14:13: check_log_file:1880: touch /dev/null
>> > stderr: ++ 17:14:13: check_log_file:1881: getent passwd postgres
>> > stderr: ++ 17:14:13: check_log_file:1881: cut -d : -f 4
>> > stderr: + 17:14:13: check_log_file:1881: chown postgres:26 /dev/null
>> > stderr: + 17:14:13: check_log_file:1885: runasowner 'test -w
>> /dev/null'
>> > stderr: + 17:14:13: runasowner:467: local quietrun=
>> > stderr: + 17:14:13: runasowner:468: local loglevel=-err
>> > stderr: + 17:14:13: runasowner:469: local var
>> > stderr: + 17:14:13: runasowner:471: for var in 1 2
>> > stderr: + 17:14:13: runasowner:473: case "$1" in
>> > stderr: + 17:14:13: runasowner:471: for var in 1 2
>> > stderr: + 17:14:13: runasowner:473: case "$1" in
>> > stderr: + 17:14:13: runasowner:485: ocf_run -err runuser postgres
>> -c 'cd /var/lib/pgsql/9.3/data/; test -w /dev/null'
>> > stderr: + 17:14:13: ocf_run:413: local rc
>> > stderr: + 17:14:13: ocf_run:414: local output
>> > stderr: + 17:14:13: ocf_run:415: local verbose=1
>> > stderr: + 17:14:13: ocf_run:416: local loglevel=err
>> > stderr: + 17:14:13: ocf_run:417: local var
>> > stderr: + 17:14:13: ocf_run:419: for var in 1 2
>> > stderr: + 17:14:13: ocf_run:421: case "$1" in
>> > stderr: ++ 17:14:13: ocf_run:426: echo -err
>> > stderr: ++ 17:14:13: ocf_run:426: sed -e s/-//g
>> > stderr: + 17:14:13: ocf_run:426: loglevel=err
>> > stderr: + 17:14:13: ocf_run:427: shift 1
>> > stderr: + 17:14:13: ocf_run:419: for var in 1 2
>> > stderr: + 17:14:13: ocf_run:421: case "$1" in
>> > stderr: ++ 17:14:13: ocf_run:433: runuser postgres -c 'cd
>> /var/lib/pgsql/9.3/data/; test -w /dev/null'
>> > stderr: + 17:14:13: ocf_run:433: output=
>> > stderr: + 17:14:13: ocf_run:434: rc=0
>> > stderr: ++ 17:14:13: ocf_run:435: echo
>> > stderr: + 17:14:13: ocf_run:435: output=
>> > stderr: + 17:14:13: ocf_run:436: '[' 0 -eq 0 ']'
>> > stderr: + 17:14:13: ocf_run:437: '[' 1 -a '!' -z '' ']'
>> > stderr: + 17:14:13: ocf_run:440: return 0
>> > stderr: + 17:14:13: check_log_file:1890: return 0
>> > stderr: + 17:14:13: pgsql_real_start:564: '[' -n '' ']'
>> > stderr: + 17:14:13: pgsql_real_start:569: '[' sync = slave ']'
>> > stderr: + 17:14:13: pgsql_real_start:575: pgctl_options=' -D
>> /var/lib/pgsql/9.3/data/ -l /dev/null'
>> > stderr: + 17:14:13: pgsql_real_start:578: postgres_options='-c
>> config_file=/var/lib/pgsql/9.3/data//postgresql.conf'
>> > stderr: + 17:14:13: pgsql_real_start:580: '[' -n '' ']'
>> > stderr: + 17:14:13: pgsql_real_start:583: '[' -n '' ']'
>> > stderr: + 17:14:13: pgsql_real_start:588: pgctl_options=' -D
>> /var/lib/pgsql/9.3/data/ -l /dev/null -o '\''-c
>> config_file=/var/lib/pgsql/9.3/data//postgresql.conf'\'''
>> > stderr: + 17:14:13: pgsql_real_start:591: runasowner 'unset
>> PGUSER; unset PGPASSWORD; /usr/pgsql-9.3/bin/pg_ctl -D
>> /var/lib/pgsql/9.3/data/ -l /dev/null -o '\''-c
>> config_file=/var/lib/pgsql/9.3/data//postgresql.conf'\'' start'
>> > stderr: + 17:14:13: runasowner:467: local quietrun=
>> > stderr: + 17:14:13: runasowner:468: local loglevel=-err
>> > stderr: + 17:14:13: runasowner:469: local var
>> > stderr: + 17:14:13: runasowner:471: for var in 1 2
>> > stderr: + 17:14:13: runasowner:473: case "$1" in
>> > stderr: + 17:14:13: runasowner:471: for var in 1 2
>> > stderr: + 17:14:13: runasowner:473: case "$1" in
>> > stderr: + 17:14:13: runasowner:485: ocf_run -err runuser postgres
>> -c 'cd /var/lib/pgsql/9.3/data/; unset PGUSER; unset PGPASSWORD;
>> /usr/pgsql-9.3/bin/pg_ctl -D /var/lib/pgsql/9.3/data/ -l /dev/null
>> -o '\''-c config_file=/var/lib/pgsql/9.3/data//postgresql.conf'\''
>> start'
>> > stderr: + 17:14:13: ocf_run:413: local rc
>> > stderr: + 17:14:13: ocf_run:414: local output
>> > stderr: + 17:14:13: ocf_run:415: local verbose=1
>> > stderr: + 17:14:13: ocf_run:416: local loglevel=err
>> > stderr: + 17:14:13: ocf_run:417: local var
>> > stderr: + 17:14:13: ocf_run:419: for var in 1 2
>> > stderr: + 17:14:13: ocf_run:421: case "$1" in
>> > stderr: ++ 17:14:13: ocf_run:426: sed -e s/-//g
>> > stderr: ++ 17:14:13: ocf_run:426: echo -err
>> > stderr: + 17:14:13: ocf_run:426: loglevel=err
>> > stderr: + 17:14:13: ocf_run:427: shift 1
>> > stderr: + 17:14:13: ocf_run:419: for var in 1 2
>> > stderr: + 17:14:13: ocf_run:421: case "$1" in
>> > stderr: ++ 17:14:13: ocf_run:433: runuser postgres -c 'cd
>> /var/lib/pgsql/9.3/data/; unset PGUSER; unset PGPASSWORD;
>> /usr/pgsql-9.3/bin/pg_ctl -D /var/lib/pgsql/9.3/data/ -l /dev/null
>> -o '\''-c config_file=/var/lib/pgsql/9.3/data//postgresql.conf'\''
>> start'
>> > stderr: + 17:14:13: ocf_run:433: output='server starting'
>> > stderr: + 17:14:13: ocf_run:434: rc=0
>> > stderr: ++ 17:14:13: ocf_run:435: echo server starting
>> > stderr: + 17:14:13: ocf_run:435: output='server starting'
>> > stderr: + 17:14:13: ocf_run:436: '[' 0 -eq 0 ']'
>> > stderr: + 17:14:13: ocf_run:437: '[' 1 -a '!' -z 'server
>> starting' ']'
>> > stderr: + 17:14:13: ocf_run:438: ocf_log info 'server starting'
>> > stderr: + 17:14:13: ocf_log:321: '[' 2 -lt 2 ']'
>> > stderr: + 17:14:13: ocf_log:325: __OCF_PRIO=info
>> > stderr: + 17:14:13: ocf_log:326: shift
>> > stderr: + 17:14:13: ocf_log:327: __OCF_MSG='server starting'
>> > stderr: + 17:14:13: ocf_log:329: case "${__OCF_PRIO}" in
>> > stderr: + 17:14:13: ocf_log:333: __OCF_PRIO=INFO
>> > stderr: + 17:14:14: ocf_log:338: '[' INFO = DEBUG ']'
>> > stderr: + 17:14:14: ocf_log:341: ha_log 'INFO: server starting'
>> > stderr: + 17:14:14: ha_log:253: __ha_log 'INFO: server starting'
>> > stderr: + 17:14:14: __ha_log:185: local ignore_stderr=false
>> > stderr: + 17:14:14: __ha_log:186: local loglevel
>> > stderr: + 17:14:14: __ha_log:188: '[' 'xINFO: server starting' =
>> x--ignore-stderr ']'
>> > stderr: + 17:14:14: __ha_log:190: '[' none = '' ']'
>> > stderr: + 17:14:14: __ha_log:192: tty
>> > stderr: + 17:14:14: __ha_log:193: '[' x = x0 -a x = xdebug ']'
>> > stderr: + 17:14:14: __ha_log:195: '[' false = true ']'
>> > stderr: + 17:14:14: __ha_log:199: '[' '' ']'
>> > stderr: + 17:14:14: __ha_log:202: echo 'INFO: server starting'
>> > stderr: INFO: server starting
>> > stderr: + 17:14:14: __ha_log:204: return 0
>> > stderr: + 17:14:14: ocf_run:440: return 0
>> > stderr: + 17:14:14: pgsql_real_start:593: '[' 0 -eq 0 ']'
>> > stderr: + 17:14:14: pgsql_real_start:595: ocf_log info
>> 'PostgreSQL start command sent.'
>> > stderr: + 17:14:14: ocf_log:321: '[' 2 -lt 2 ']'
>> > stderr: + 17:14:14: ocf_log:325: __OCF_PRIO=info
>> > stderr: + 17:14:14: ocf_log:326: shift
>> > stderr: + 17:14:14: ocf_log:327: __OCF_MSG='PostgreSQL start
>> command sent.'
>> > stderr: + 17:14:14: ocf_log:329: case "${__OCF_PRIO}" in
>> > stderr: + 17:14:14: ocf_log:333: __OCF_PRIO=INFO
>> > stderr: + 17:14:14: ocf_log:338: '[' INFO = DEBUG ']'
>> > stderr: + 17:14:14: ocf_log:341: ha_log 'INFO: PostgreSQL start
>> command sent.'
>> > stderr: + 17:14:14: ha_log:253: __ha_log 'INFO: PostgreSQL start
>> command sent.'
>> > stderr: + 17:14:14: __ha_log:185: local ignore_stderr=false
>> > stderr: + 17:14:14: __ha_log:186: local loglevel
>> > stderr: + 17:14:14: __ha_log:188: '[' 'xINFO: PostgreSQL start
>> command sent.' = x--ignore-stderr ']'
>> > stderr: + 17:14:14: __ha_log:190: '[' none = '' ']'
>> > stderr: + 17:14:14: __ha_log:192: tty
>> > stderr: + 17:14:14: __ha_log:193: '[' x = x0 -a x = xdebug ']'
>> > stderr: + 17:14:14: __ha_log:195: '[' false = true ']'
>> > stderr: + 17:14:14: __ha_log:199: '[' '' ']'
>> > stderr: + 17:14:14: __ha_log:202: echo 'INFO: PostgreSQL start
>> command sent.'
>> > stderr: INFO: PostgreSQL start command sent.
>> > stderr: + 17:14:14: __ha_log:204: return 0
>> > stderr: + 17:14:14: pgsql_real_start:601: :
>> > stderr: + 17:14:14: pgsql_real_start:603: pgsql_real_monitor warn
>> > stderr: + 17:14:14: pgsql_real_monitor:905: local loglevel
>> > stderr: + 17:14:14: pgsql_real_monitor:906: local rc
>> > stderr: + 17:14:14: pgsql_real_monitor:907: local output
>> > stderr: + 17:14:14: pgsql_real_monitor:910: loglevel=warn
>> > stderr: + 17:14:14: pgsql_real_monitor:912: pgsql_status
>> > stderr: + 17:14:14: pgsql_status:866: '[' -f
>> /var/lib/pgsql/9.3/data//postmaster.pid ']'
>> > stderr: ++ 17:14:14: pgsql_status:868: head -n 1
>> /var/lib/pgsql/9.3/data//postmaster.pid
>> > stderr: + 17:14:14: pgsql_status:868: PID=9556
>> > stderr: + 17:14:14: pgsql_status:869: runasowner 'kill -s 0 9556
>> >/dev/null 2>&1'
>> > stderr: + 17:14:14: runasowner:467: local quietrun=
>> > stderr: + 17:14:14: runasowner:468: local loglevel=-err
>> > stderr: + 17:14:14: runasowner:469: local var
>> > stderr: + 17:14:14: runasowner:471: for var in 1 2
>> > stderr: + 17:14:14: runasowner:473: case "$1" in
>> > stderr: + 17:14:14: runasowner:471: for var in 1 2
>> > stderr: + 17:14:14: runasowner:473: case "$1" in
>> > stderr: + 17:14:14: runasowner:485: ocf_run -err runuser postgres
>> -c 'cd /var/lib/pgsql/9.3/data/; kill -s 0 9556 >/dev/null 2>&1'
>> > stderr: + 17:14:14: ocf_run:413: local rc
>> > stderr: + 17:14:14: ocf_run:414: local output
>> > stderr: + 17:14:14: ocf_run:415: local verbose=1
>> > stderr: + 17:14:14: ocf_run:416: local loglevel=err
>> > stderr: + 17:14:14: ocf_run:417: local var
>> > stderr: + 17:14:14: ocf_run:419: for var in 1 2
>> > stderr: + 17:14:14: ocf_run:421: case "$1" in
>> > stderr: ++ 17:14:14: ocf_run:426: echo -err
>> > stderr: ++ 17:14:14: ocf_run:426: sed -e s/-//g
>> > stderr: + 17:14:14: ocf_run:426: loglevel=err
>> > stderr: + 17:14:14: ocf_run:427: shift 1
>> > stderr: + 17:14:14: ocf_run:419: for var in 1 2
>> > stderr: + 17:14:14: ocf_run:421: case "$1" in
>> > stderr: ++ 17:14:14: ocf_run:433: runuser postgres -c 'cd
>> /var/lib/pgsql/9.3/data/; kill -s 0 9556 >/dev/null 2>&1'
>> > stderr: + 17:14:14: ocf_run:433: output=
>> > stderr: + 17:14:14: ocf_run:434: rc=0
>> > stderr: ++ 17:14:14: ocf_run:435: echo
>> > stderr: + 17:14:14: ocf_run:435: output=
>> > stderr: + 17:14:14: ocf_run:436: '[' 0 -eq 0 ']'
>> > stderr: + 17:14:14: ocf_run:437: '[' 1 -a '!' -z '' ']'
>> > stderr: + 17:14:14: ocf_run:440: return 0
>> > stderr: + 17:14:14: pgsql_status:870: return 0
>> > stderr: + 17:14:14: pgsql_real_monitor:918: is_replication
>> > stderr: + 17:14:14: is_replication:1287: '[' sync '!=' none -a
>> sync '!=' slave ']'
>> > stderr: + 17:14:14: is_replication:1288: return 0
>> > stderr: ++ 17:14:14: pgsql_real_monitor:920: exec_sql 'select
>> pg_is_in_recovery()'
>> > stderr: ++ 17:14:14: exec_sql:518: local 'sql=select
>> pg_is_in_recovery()'
>> > stderr: ++ 17:14:14: exec_sql:519: local output
>> > stderr: ++ 17:14:14: exec_sql:520: local rc
>> > stderr: +++ 17:14:14: exec_sql:524: runuser postgres -c 'cd
>> /var/lib/pgsql/9.3/data/; /usr/pgsql-9.3/bin/psql -p 5432 -U postgres
>> template1 -U postgres -Atc "select pg_is_in_recovery()"'
>> > stderr: ++ 17:14:14: exec_sql:524: output=f
>> > stderr: ++ 17:14:14: exec_sql:525: rc=0
>> > stderr: ++ 17:14:14: exec_sql:527: echo f
>> > stderr: ++ 17:14:14: exec_sql:528: return 0
>> > stderr: + 17:14:14: pgsql_real_monitor:920: output=f
>> > stderr: + 17:14:14: pgsql_real_monitor:921: rc=0
>> > stderr: + 17:14:14: pgsql_real_monitor:923: '[' 0 -ne 0 ']'
>> > stderr: + 17:14:14: pgsql_real_monitor:928: case "$output" in
>> > stderr: + 17:14:14: pgsql_real_monitor:929: ocf_log debug
>> 'PostgreSQL is running as a primary.'
>> > stderr: + 17:14:14: ocf_log:321: '[' 2 -lt 2 ']'
>> > stderr: + 17:14:14: ocf_log:325: __OCF_PRIO=debug
>> > stderr: + 17:14:14: ocf_log:326: shift
>> > stderr: + 17:14:14: ocf_log:327: __OCF_MSG='PostgreSQL is running
>> as a primary.'
>> > stderr: + 17:14:14: ocf_log:329: case "${__OCF_PRIO}" in
>> > stderr: + 17:14:14: ocf_log:334: __OCF_PRIO=DEBUG
>> > stderr: + 17:14:14: ocf_log:338: '[' DEBUG = DEBUG ']'
>> > stderr: + 17:14:14: ocf_log:339: ha_debug 'DEBUG: PostgreSQL is
>> running as a primary.'
>> > stderr: + 17:14:14: ha_debug:258: '[' x = x0 ']'
>> > stderr: + 17:14:14: ha_debug:261: tty
>> > stderr: + 17:14:14: ha_debug:262: '[' '' ']'
>> > stderr: + 17:14:14: ha_debug:265: echo 'DEBUG: PostgreSQL is
>> running as a primary.'
>> > stderr: DEBUG: PostgreSQL is running as a primary.
>> > stderr: + 17:14:14: ha_debug:267: return 0
>> > stderr: + 17:14:14: pgsql_real_monitor:930: '[' 'select now();' =
>> 'select now();' ']'
>> > stderr: + 17:14:14: pgsql_real_monitor:931: return 8
>> > stderr: + 17:14:14: pgsql_real_start:604: rc=8
>> > stderr: + 17:14:14: pgsql_real_start:605: '[' 8 -eq 0 -o 8 -eq 8 ']'
>> > stderr: + 17:14:14: pgsql_real_start:606: break
>> > stderr: + 17:14:14: pgsql_real_start:614: use_replication_slot
>> > stderr: + 17:14:14: use_replication_slot:1294: '[' -n '' ']'
>> > stderr: + 17:14:14: use_replication_slot:1298: return 1
>> > stderr: + 17:14:14: pgsql_real_start:622: ocf_log info
>> 'PostgreSQL is started.'
>> > stderr: + 17:14:14: ocf_log:321: '[' 2 -lt 2 ']'
>> > stderr: + 17:14:14: ocf_log:325: __OCF_PRIO=info
>> > stderr: + 17:14:14: ocf_log:326: shift
>> > stderr: + 17:14:14: ocf_log:327: __OCF_MSG='PostgreSQL is started.'
>> > stderr: + 17:14:14: ocf_log:329: case "${__OCF_PRIO}" in
>> > stderr: + 17:14:14: ocf_log:333: __OCF_PRIO=INFO
>> > stderr: + 17:14:14: ocf_log:338: '[' INFO = DEBUG ']'
>> > stderr: + 17:14:14: ocf_log:341: ha_log 'INFO: PostgreSQL is
>> started.'
>> > stderr: + 17:14:14: ha_log:253: __ha_log 'INFO: PostgreSQL is
>> started.'
>> > stderr: + 17:14:14: __ha_log:185: local ignore_stderr=false
>> > stderr: + 17:14:14: __ha_log:186: local loglevel
>> > stderr: + 17:14:14: __ha_log:188: '[' 'xINFO: PostgreSQL is
>> started.' = x--ignore-stderr ']'
>> > stderr: + 17:14:14: __ha_log:190: '[' none = '' ']'
>> > stderr: + 17:14:14: __ha_log:192: tty
>> > stderr: + 17:14:14: __ha_log:193: '[' x = x0 -a x = xdebug ']'
>> > stderr: + 17:14:14: __ha_log:195: '[' false = true ']'
>> > stderr: + 17:14:14: __ha_log:199: '[' '' ']'
>> > stderr: + 17:14:14: __ha_log:202: echo 'INFO: PostgreSQL is
>> started.'
>> > stderr: INFO: PostgreSQL is started.
>> > stderr: + 17:14:14: __ha_log:204: return 0
>> > stderr: + 17:14:14: pgsql_real_start:623: return 8
>> > stderr: + 17:14:14: pgsql_promote:690: rc=8
>> > stderr: + 17:14:14: pgsql_promote:691: '[' 8 -ne 8 ']'
>> > stderr: + 17:14:14: pgsql_promote:723: change_data_status pm1 LATEST
>> > stderr: + 17:14:14: change_data_status:1569: local output
>> > stderr: + 17:14:14: change_data_status:1571: node_exist pm1
>> > stderr: + 17:14:14: node_exist:1720: print_crm_mon
>> > stderr: + 17:14:14: node_exist:1720: grep -q '^node pm1'
>> > stderr: + 17:14:14: node_exist:1720: tr '[A-Z]' '[a-z]'
>> > stderr: + 17:14:14: print_crm_mon:1924: '[' -z '' ']'
>> > stderr: ++ 17:14:14: print_crm_mon:1925: exec_with_retry 0
>> crm_mon -n1
>> > stderr: ++ 17:14:14: exec_with_retry:1689: local count=86400
>> > stderr: ++ 17:14:14: exec_with_retry:1690: local output
>> > stderr: ++ 17:14:14: exec_with_retry:1691: local rc
>> > stderr: ++ 17:14:14: exec_with_retry:1693: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:14: exec_with_retry:1696: shift
>> > stderr: ++ 17:14:14: exec_with_retry:1698: '[' 86400 -gt 0 ']'
>> > stderr: +++ 17:14:14: exec_with_retry:1699: crm_mon -n1
>> > stderr: ++ 17:14:14: exec_with_retry:1699: output='Last updated:
>> Mon Oct 12 17:14:14 2015 Last change: Mon Oct 12 16:07:56 2015
>> by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: ++ 17:14:14: exec_with_retry:1700: rc=0
>> > stderr: ++ 17:14:14: exec_with_retry:1701: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:14: exec_with_retry:1706: printf 'Last updated:
>> Mon Oct 12 17:14:14 2015 Last change: Mon Oct 12 16:07:56 2015
>> by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: ++ 17:14:14: exec_with_retry:1707: return 0
>> > stderr: + 17:14:14: print_crm_mon:1925: CRM_MON_OUTPUT='Last
>> updated: Mon Oct 12 17:14:14 2015 Last change: Mon Oct 12 16:07:56
>> 2015 by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: + 17:14:14: print_crm_mon:1927: printf 'Last updated: Mon
>> Oct 12 17:14:14 2015 Last change: Mon Oct 12 16:07:56 2015 by
>> root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave\n'
>> > stderr: + 17:14:14: change_data_status:1575: :
>> > stderr: ++ 17:14:14: change_data_status:1577:
>> /usr/sbin/crm_attribute -l forever -N pm1 -n pgsql-data-status -G -q
>> > stderr: + 17:14:14: change_data_status:1577: output=LATEST
>> > stderr: + 17:14:14: change_data_status:1578: '[' LATEST '!='
>> LATEST ']'
>> > stderr: + 17:14:14: change_data_status:1582: break
>> > stderr: + 17:14:14: change_data_status:1585: return 0
>> > stderr: + 17:14:14: pgsql_promote:724: exec_with_retry 0
>> /usr/sbin/crm_master -l reboot -v 1000
>> > stderr: + 17:14:14: exec_with_retry:1689: local count=86400
>> > stderr: + 17:14:14: exec_with_retry:1690: local output
>> > stderr: + 17:14:14: exec_with_retry:1691: local rc
>> > stderr: + 17:14:14: exec_with_retry:1693: '[' 0 -ne 0 ']'
>> > stderr: + 17:14:14: exec_with_retry:1696: shift
>> > stderr: + 17:14:14: exec_with_retry:1698: '[' 86400 -gt 0 ']'
>> > stderr: ++ 17:14:14: exec_with_retry:1699: /usr/sbin/crm_master
>> -l reboot -v 1000
>> > stderr: + 17:14:14: exec_with_retry:1699: output=
>> > stderr: + 17:14:14: exec_with_retry:1700: rc=0
>> > stderr: + 17:14:14: exec_with_retry:1701: '[' 0 -ne 0 ']'
>> > stderr: + 17:14:14: exec_with_retry:1706: printf ''
>> > stderr: + 17:14:14: exec_with_retry:1707: return 0
>> > stderr: + 17:14:14: pgsql_promote:725: change_pgsql_status pm1 PRI
>> > stderr: + 17:14:14: change_pgsql_status:1543: local output
>> > stderr: + 17:14:14: change_pgsql_status:1545: is_node_online pm1
>> > stderr: + 17:14:14: is_node_online:1716: print_crm_mon
>> > stderr: + 17:14:14: is_node_online:1716: tr '[A-Z]' '[a-z]'
>> > stderr: + 17:14:14: is_node_online:1716: grep -e '^node pm1 ' -e
>> '^node pm1:'
>> > stderr: + 17:14:14: is_node_online:1716: grep -q -v offline
>> > stderr: + 17:14:14: print_crm_mon:1924: '[' -z '' ']'
>> > stderr: ++ 17:14:14: print_crm_mon:1925: exec_with_retry 0
>> crm_mon -n1
>> > stderr: ++ 17:14:14: exec_with_retry:1689: local count=86400
>> > stderr: ++ 17:14:14: exec_with_retry:1690: local output
>> > stderr: ++ 17:14:14: exec_with_retry:1691: local rc
>> > stderr: ++ 17:14:14: exec_with_retry:1693: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:14: exec_with_retry:1696: shift
>> > stderr: ++ 17:14:14: exec_with_retry:1698: '[' 86400 -gt 0 ']'
>> > stderr: +++ 17:14:14: exec_with_retry:1699: crm_mon -n1
>> > stderr: ++ 17:14:14: exec_with_retry:1699: output='Last updated:
>> Mon Oct 12 17:14:14 2015 Last change: Mon Oct 12 16:07:56 2015
>> by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: ++ 17:14:14: exec_with_retry:1700: rc=0
>> > stderr: ++ 17:14:14: exec_with_retry:1701: '[' 0 -ne 0 ']'
>> > stderr: ++ 17:14:14: exec_with_retry:1706: printf 'Last updated:
>> Mon Oct 12 17:14:14 2015 Last change: Mon Oct 12 16:07:56 2015
>> by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: ++ 17:14:14: exec_with_retry:1707: return 0
>> > stderr: + 17:14:14: print_crm_mon:1925: CRM_MON_OUTPUT='Last
>> updated: Mon Oct 12 17:14:14 2015 Last change: Mon Oct 12 16:07:56
>> 2015 by root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave'
>> > stderr: + 17:14:14: print_crm_mon:1927: printf 'Last updated: Mon
>> Oct 12 17:14:14 2015 Last change: Mon Oct 12 16:07:56 2015 by
>> root via crm_attribute on pm1
>> > stderr: Stack: corosync
>> > stderr: Current DC: pm2 (version 1.1.13-a14efad) - partition with
>> quorum
>> > stderr: 2 nodes and 2 resources configured
>> > stderr:
>> > stderr: Node pm1: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Started
>> > stderr: Node pm2: online
>> > stderr: pgsql (ocf::heartbeat:pgsql): Slave\n'
>> > stderr: ++ 17:14:14: change_pgsql_status:1549:
>> /usr/sbin/crm_attribute -l reboot -N pm1 -n pgsql-status -G -q
>> > stderr: + 17:14:14: change_pgsql_status:1549: output=HS:alone
>> > stderr: + 17:14:14: change_pgsql_status:1550: '[' HS:alone '!='
>> PRI ']'
>> > stderr: + 17:14:14: change_pgsql_status:1554: '[' HS:alone = STOP
>> -o HS:alone = UNKNOWN ']'
>> > stderr: + 17:14:14: change_pgsql_status:1560: ocf_log info
>> 'Changing pgsql-status on pm1 : HS:alone->PRI.'
>> > stderr: + 17:14:14: ocf_log:321: '[' 2 -lt 2 ']'
>> > stderr: + 17:14:14: ocf_log:325: __OCF_PRIO=info
>> > stderr: + 17:14:14: ocf_log:326: shift
>> > stderr: + 17:14:14: ocf_log:327: __OCF_MSG='Changing pgsql-status
>> on pm1 : HS:alone->PRI.'
>> > stderr: + 17:14:14: ocf_log:329: case "${__OCF_PRIO}" in
>> > stderr: + 17:14:14: ocf_log:333: __OCF_PRIO=INFO
>> > stderr: + 17:14:14: ocf_log:338: '[' INFO = DEBUG ']'
>> > stderr: + 17:14:14: ocf_log:341: ha_log 'INFO: Changing
>> pgsql-status on pm1 : HS:alone->PRI.'
>> > stderr: + 17:14:14: ha_log:253: __ha_log 'INFO: Changing
>> pgsql-status on pm1 : HS:alone->PRI.'
>> > stderr: + 17:14:14: __ha_log:185: local ignore_stderr=false
>> > stderr: + 17:14:14: __ha_log:186: local loglevel
>> > stderr: + 17:14:14: __ha_log:188: '[' 'xINFO: Changing
>> pgsql-status on pm1 : HS:alone->PRI.' = x--ignore-stderr ']'
>> > stderr: + 17:14:14: __ha_log:190: '[' none = '' ']'
>> > stderr: + 17:14:14: __ha_log:192: tty
>> > stderr: + 17:14:14: __ha_log:193: '[' x = x0 -a x = xdebug ']'
>> > stderr: + 17:14:14: __ha_log:195: '[' false = true ']'
>> > stderr: + 17:14:14: __ha_log:199: '[' '' ']'
>> > stderr: + 17:14:14: __ha_log:202: echo 'INFO: Changing
>> pgsql-status on pm1 : HS:alone->PRI.'
>> > stderr: INFO: Changing pgsql-status on pm1 : HS:alone->PRI.
>> > stderr: + 17:14:14: __ha_log:204: return 0
>> > stderr: + 17:14:14: change_pgsql_status:1561: exec_with_retry 0
>> /usr/sbin/crm_attribute -l reboot -N pm1 -n pgsql-status -v PRI
>> > stderr: + 17:14:14: exec_with_retry:1689: local count=86400
>> > stderr: + 17:14:14: exec_with_retry:1690: local output
>> > stderr: + 17:14:14: exec_with_retry:1691: local rc
>> > stderr: + 17:14:14: exec_with_retry:1693: '[' 0 -ne 0 ']'
>> > stderr: + 17:14:14: exec_with_retry:1696: shift
>> > stderr: + 17:14:14: exec_with_retry:1698: '[' 86400 -gt 0 ']'
>> > stderr: ++ 17:14:14: exec_with_retry:1699:
>> /usr/sbin/crm_attribute -l reboot -N pm1 -n pgsql-status -v PRI
>> > stderr: + 17:14:14: exec_with_retry:1699: output=
>> > stderr: + 17:14:14: exec_with_retry:1700: rc=0
>> > stderr: + 17:14:14: exec_with_retry:1701: '[' 0 -ne 0 ']'
>> > stderr: + 17:14:14: exec_with_retry:1706: printf ''
>> > stderr: + 17:14:14: exec_with_retry:1707: return 0
>> > stderr: + 17:14:14: change_pgsql_status:1563: return 0
>> > stderr: + 17:14:14: pgsql_promote:726: return 0
>> > stderr: + 17:14:14: 2058: exit 0
>>
>>
>> Thanks in advance!
>>
>>
>> _______________________________________________
>> Users mailing list: Users at clusterlabs.org
>> http://clusterlabs.org/mailman/listinfo/users
>>
>> Project Home: http://www.clusterlabs.org
>> Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf
>> Bugs: http://bugs.clusterlabs.org
>
More information about the Users
mailing list