Nov 11 01:24:31 psql01 kernel: imklog 3.18.6, log source = /proc/kmsg started. Nov 11 01:24:31 psql01 kernel: [ 0.000000] Initializing cgroup subsys cpuset Nov 11 01:24:31 psql01 kernel: [ 0.000000] Initializing cgroup subsys cpu Nov 11 01:24:31 psql01 kernel: [ 0.000000] Linux version 2.6.26-2-686 (Debian 2.6.26-19) (dannf@debian.org) (gcc version 4.1.3 20080704 (prerelease) (Debian 4.1.2-25)) #1 SMP Wed Aug 19 06:06:52 UTC 2009 Nov 11 01:24:31 psql01 kernel: [ 0.000000] BIOS-provided physical RAM map: Nov 11 01:24:31 psql01 kernel: [ 0.000000] BIOS-e820: 0000000000000000 - 000000000009f800 (usable) Nov 11 01:24:31 psql01 kernel: [ 0.000000] BIOS-e820: 000000000009f800 - 00000000000a0000 (reserved) Nov 11 01:24:31 psql01 kernel: [ 0.000000] BIOS-e820: 00000000000ca000 - 00000000000cc000 (reserved) Nov 11 01:24:31 psql01 kernel: [ 0.000000] BIOS-e820: 00000000000dc000 - 0000000000100000 (reserved) Nov 11 01:24:31 psql01 kernel: [ 0.000000] BIOS-e820: 0000000000100000 - 000000001fef0000 (usable) Nov 11 01:24:31 psql01 kernel: [ 0.000000] BIOS-e820: 000000001fef0000 - 000000001feff000 (ACPI data) Nov 11 01:24:31 psql01 rsyslogd: [origin software="rsyslogd" swVersion="3.18.6" x-pid="1773" x-info="http://www.rsyslog.com"] restart Nov 11 01:24:31 psql01 kernel: [ 0.000000] BIOS-e820: 000000001feff000 - 000000001ff00000 (ACPI NVS) Nov 11 01:24:31 psql01 kernel: [ 0.000000] BIOS-e820: 000000001ff00000 - 0000000020000000 (usable) Nov 11 01:24:31 psql01 kernel: [ 0.000000] BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved) Nov 11 01:24:31 psql01 kernel: [ 0.000000] BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved) Nov 11 01:24:31 psql01 kernel: [ 0.000000] BIOS-e820: 00000000fffe0000 - 0000000100000000 (reserved) Nov 11 01:24:31 psql01 kernel: [ 0.000000] 0MB HIGHMEM available. Nov 11 01:24:31 psql01 kernel: [ 0.000000] 512MB LOWMEM available. Nov 11 01:24:31 psql01 kernel: [ 0.000000] found SMP MP-table at [c00f6cd0] 000f6cd0 Nov 11 01:24:31 psql01 kernel: [ 0.000000] Entering add_active_range(0, 0, 131072) 0 entries of 256 used Nov 11 01:24:31 psql01 kernel: [ 0.000000] Zone PFN ranges: Nov 11 01:24:31 psql01 kernel: [ 0.000000] DMA 0 -> 4096 Nov 11 01:24:31 psql01 kernel: [ 0.000000] Normal 4096 -> 131072 Nov 11 01:24:31 psql01 kernel: [ 0.000000] HighMem 131072 -> 131072 Nov 11 01:24:31 psql01 kernel: [ 0.000000] Movable zone start PFN for each node Nov 11 01:24:31 psql01 kernel: [ 0.000000] early_node_map[1] active PFN ranges Nov 11 01:24:31 psql01 kernel: [ 0.000000] 0: 0 -> 131072 Nov 11 01:24:31 psql01 kernel: [ 0.000000] On node 0 totalpages: 131072 Nov 11 01:24:31 psql01 kernel: [ 0.000000] DMA zone: 32 pages used for memmap Nov 11 01:24:31 psql01 kernel: [ 0.000000] DMA zone: 0 pages reserved Nov 11 01:24:31 psql01 kernel: [ 0.000000] DMA zone: 4064 pages, LIFO batch:0 Nov 11 01:24:31 psql01 kernel: [ 0.000000] Normal zone: 992 pages used for memmap Nov 11 01:24:31 psql01 kernel: [ 0.000000] Normal zone: 125984 pages, LIFO batch:31 Nov 11 01:24:31 psql01 kernel: [ 0.000000] HighMem zone: 0 pages used for memmap Nov 11 01:24:31 psql01 kernel: [ 0.000000] Movable zone: 0 pages used for memmap Nov 11 01:24:31 psql01 kernel: [ 0.000000] DMI present. Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: RSDP 000F6C60, 0014 (r0 PTLTD ) Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: RSDT 1FEFAB68, 0030 (r1 PTLTD RSDT 6040000 LTP 0) Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: FACP 1FEFEF14, 0074 (r1 INTEL 440BX 6040000 PTL F4240) Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: DSDT 1FEFAB98, 437C (r1 PTLTD Custom 6040000 MSFT 100000D) Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: FACS 1FEFFFC0, 0040 Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: APIC 1FEFEF88, 0050 (r1 PTLTD APIC 6040000 LTP 0) Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: BOOT 1FEFEFD8, 0028 (r1 PTLTD $SBFTBL$ 6040000 LTP 1) Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: PM-Timer IO Port: 0x1008 Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: Local APIC address 0xfee00000 Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0]) Nov 11 01:24:31 psql01 kernel: [ 0.000000] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23 Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge) Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: IRQ0 used by override. Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: IRQ2 used by override. Nov 11 01:24:31 psql01 kernel: [ 0.000000] ACPI: IRQ9 used by override. Nov 11 01:24:31 psql01 kernel: [ 0.000000] Enabling APIC mode: Flat. Using 1 I/O APICs Nov 11 01:24:31 psql01 kernel: [ 0.000000] Using ACPI (MADT) for SMP configuration information Nov 11 01:24:31 psql01 kernel: [ 0.000000] Allocating PCI resources starting at 30000000 (gap: 20000000:dec00000) Nov 11 01:24:31 psql01 kernel: [ 0.000000] PM: Registered nosave memory: 000000000009f000 - 00000000000a0000 Nov 11 01:24:31 psql01 kernel: [ 0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000ca000 Nov 11 01:24:31 psql01 kernel: [ 0.000000] PM: Registered nosave memory: 00000000000ca000 - 00000000000cc000 Nov 11 01:24:31 psql01 kernel: [ 0.000000] PM: Registered nosave memory: 00000000000cc000 - 00000000000dc000 Nov 11 01:24:31 psql01 kernel: [ 0.000000] PM: Registered nosave memory: 00000000000dc000 - 0000000000100000 Nov 11 01:24:31 psql01 kernel: [ 0.000000] PM: Registered nosave memory: 000000001fef0000 - 000000001feff000 Nov 11 01:24:31 psql01 kernel: [ 0.000000] PM: Registered nosave memory: 000000001feff000 - 000000001ff00000 Nov 11 01:24:31 psql01 kernel: [ 0.000000] SMP: Allowing 1 CPUs, 0 hotplug CPUs Nov 11 01:24:31 psql01 kernel: [ 0.000000] PERCPU: Allocating 37960 bytes of per cpu data Nov 11 01:24:31 psql01 kernel: [ 0.000000] NR_CPUS: 8, nr_cpu_ids: 1 Nov 11 01:24:31 psql01 kernel: [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 130048 Nov 11 01:24:31 psql01 kernel: [ 0.000000] Kernel command line: root=/dev/sda1 ro quiet Nov 11 01:24:31 psql01 kernel: [ 0.000000] mapped APIC to ffffb000 (fee00000) Nov 11 01:24:31 psql01 kernel: [ 0.000000] mapped IOAPIC to ffffa000 (fec00000) Nov 11 01:24:31 psql01 kernel: [ 0.000000] Enabling fast FPU save and restore... done. Nov 11 01:24:31 psql01 kernel: [ 0.000000] Enabling unmasked SIMD FPU exception support... done. Nov 11 01:24:31 psql01 kernel: [ 0.000000] Initializing CPU#0 Nov 11 01:24:31 psql01 kernel: [ 0.000000] PID hash table entries: 2048 (order: 11, 8192 bytes) Nov 11 01:24:31 psql01 kernel: [ 0.000000] Detected 3198.993 MHz processor. Nov 11 01:24:31 psql01 kernel: [ 0.004000] Console: colour VGA+ 80x25 Nov 11 01:24:31 psql01 kernel: [ 0.004000] console [tty0] enabled Nov 11 01:24:31 psql01 kernel: [ 0.004000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes) Nov 11 01:24:31 psql01 kernel: [ 0.004000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes) Nov 11 01:24:31 psql01 kernel: [ 0.004000] Memory: 509764k/524288k available (1770k kernel code, 13824k reserved, 751k data, 244k init, 0k highmem) Nov 11 01:24:31 psql01 kernel: [ 0.004000] virtual kernel memory layout: Nov 11 01:24:31 psql01 kernel: [ 0.004000] fixmap : 0xfff4c000 - 0xfffff000 ( 716 kB) Nov 11 01:24:31 psql01 kernel: [ 0.004000] pkmap : 0xff800000 - 0xffc00000 (4096 kB) Nov 11 01:24:31 psql01 kernel: [ 0.004000] vmalloc : 0xe0800000 - 0xff7fe000 ( 495 MB) Nov 11 01:24:31 psql01 kernel: [ 0.004000] lowmem : 0xc0000000 - 0xe0000000 ( 512 MB) Nov 11 01:24:31 psql01 kernel: [ 0.004000] .init : 0xc037f000 - 0xc03bc000 ( 244 kB) Nov 11 01:24:31 psql01 kernel: [ 0.004000] .data : 0xc02ba9a9 - 0xc0376620 ( 751 kB) Nov 11 01:24:31 psql01 kernel: [ 0.004000] .text : 0xc0100000 - 0xc02ba9a9 (1770 kB) Nov 11 01:24:31 psql01 kernel: [ 0.004000] Checking if this processor honours the WP bit even in supervisor mode...Ok. Nov 11 01:24:31 psql01 kernel: [ 0.004000] CPA: page pool initialized 1 of 1 pages preallocated Nov 11 01:24:31 psql01 kernel: [ 0.087807] Calibrating delay using timer specific routine.. 6429.48 BogoMIPS (lpj=12858965) Nov 11 01:24:31 psql01 kernel: [ 0.087869] Security Framework initialized Nov 11 01:24:31 psql01 kernel: [ 0.087932] SELinux: Disabled at boot. Nov 11 01:24:31 psql01 kernel: [ 0.087994] Capability LSM initialized Nov 11 01:24:31 psql01 kernel: [ 0.088005] Mount-cache hash table entries: 512 Nov 11 01:24:31 psql01 kernel: [ 0.088005] Initializing cgroup subsys ns Nov 11 01:24:31 psql01 kernel: [ 0.088005] Initializing cgroup subsys cpuacct Nov 11 01:24:31 psql01 kernel: [ 0.088005] Initializing cgroup subsys devices Nov 11 01:24:31 psql01 kernel: [ 0.088005] CPU: Trace cache: 12K uops, L1 D cache: 16K Nov 11 01:24:31 psql01 kernel: [ 0.088005] CPU: L2 cache: 1024K Nov 11 01:24:31 psql01 kernel: [ 0.088005] Intel machine check architecture supported. Nov 11 01:24:31 psql01 kernel: [ 0.088005] Intel machine check reporting enabled on CPU#0. Nov 11 01:24:31 psql01 kernel: [ 0.088005] Checking 'hlt' instruction... OK. Nov 11 01:24:31 psql01 kernel: [ 0.103248] SMP alternatives: switching to UP code Nov 11 01:24:31 psql01 kernel: [ 0.127144] Freeing SMP alternatives: 16k freed Nov 11 01:24:31 psql01 kernel: [ 0.127207] ACPI: Core revision 20080321 Nov 11 01:24:31 psql01 kernel: [ 0.131580] ENABLING IO-APIC IRQs Nov 11 01:24:31 psql01 kernel: [ 0.132008] ..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1 Nov 11 01:24:31 psql01 kernel: [ 0.172007] CPU0: Intel(R) Xeon(TM) CPU 3.20GHz stepping 08 Nov 11 01:24:31 psql01 kernel: [ 0.172010] Brought up 1 CPUs Nov 11 01:24:31 psql01 kernel: [ 0.172010] Total of 1 processors activated (6429.48 BogoMIPS). Nov 11 01:24:31 psql01 kernel: [ 0.172010] CPU0 attaching sched-domain: Nov 11 01:24:31 psql01 kernel: [ 0.172010] domain 0: span 0 Nov 11 01:24:31 psql01 kernel: [ 0.172010] groups: 0 Nov 11 01:24:31 psql01 kernel: [ 0.187637] net_namespace: 660 bytes Nov 11 01:24:31 psql01 kernel: [ 0.187663] Booting paravirtualized kernel on bare hardware Nov 11 01:24:31 psql01 kernel: [ 0.195283] NET: Registered protocol family 16 Nov 11 01:24:31 psql01 kernel: [ 0.203498] ACPI: bus type pci registered Nov 11 01:24:31 psql01 kernel: [ 0.207344] PCI: PCI BIOS revision 2.10 entry at 0xfd9a0, last bus=1 Nov 11 01:24:31 psql01 kernel: [ 0.207370] PCI: Using configuration type 1 for base access Nov 11 01:24:31 psql01 kernel: [ 0.207396] Setting up standard PCI resources Nov 11 01:24:31 psql01 kernel: [ 0.237140] ACPI: EC: Look up EC in DSDT Nov 11 01:24:31 psql01 kernel: [ 0.293040] ACPI: Interpreter enabled Nov 11 01:24:31 psql01 kernel: [ 0.293094] ACPI: (supports S0 S1 S4 S5) Nov 11 01:24:31 psql01 kernel: [ 0.293157] ACPI: Using IOAPIC for interrupt routing Nov 11 01:24:31 psql01 kernel: [ 0.353767] ACPI: PCI Root Bridge [PCI0] (0000:00) Nov 11 01:24:31 psql01 kernel: [ 0.368931] pci 0000:00:07.3: quirk: region 1000-103f claimed by PIIX4 ACPI Nov 11 01:24:31 psql01 kernel: [ 0.368993] pci 0000:00:07.3: quirk: region 1040-104f claimed by PIIX4 SMB Nov 11 01:24:31 psql01 kernel: [ 0.380914] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT] Nov 11 01:24:31 psql01 kernel: [ 0.393267] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 11 14 15) *0, disabled. Nov 11 01:24:31 psql01 kernel: [ 0.393330] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *9 10 11 14 15) Nov 11 01:24:31 psql01 kernel: [ 0.393392] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 9 10 *11 14 15) Nov 11 01:24:31 psql01 kernel: [ 0.393455] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 11 14 15) *0, disabled. Nov 11 01:24:31 psql01 kernel: [ 0.393825] Linux Plug and Play Support v0.97 (c) Adam Belay Nov 11 01:24:31 psql01 kernel: [ 0.393992] pnp: PnP ACPI init Nov 11 01:24:31 psql01 kernel: [ 0.394054] ACPI: bus type pnp registered Nov 11 01:24:31 psql01 kernel: [ 0.492053] pnp: PnP ACPI: found 12 devices Nov 11 01:24:31 psql01 kernel: [ 0.492116] ACPI: ACPI bus type pnp unregistered Nov 11 01:24:31 psql01 kernel: [ 0.492178] PnPBIOS: Disabled by ACPI PNP Nov 11 01:24:31 psql01 kernel: [ 0.497726] PCI: Using ACPI for IRQ routing Nov 11 01:24:31 psql01 kernel: [ 0.512349] system 00:01: ioport range 0x1000-0x103f has been reserved Nov 11 01:24:31 psql01 kernel: [ 0.512379] system 00:01: ioport range 0x1040-0x104f has been reserved Nov 11 01:24:31 psql01 kernel: [ 0.552122] PCI: Bridge: 0000:00:01.0 Nov 11 01:24:31 psql01 kernel: [ 0.552155] IO window: disabled. Nov 11 01:24:31 psql01 kernel: [ 0.552218] MEM window: disabled. Nov 11 01:24:31 psql01 kernel: [ 0.552280] PREFETCH window: disabled. Nov 11 01:24:31 psql01 kernel: [ 0.556124] PCI: Setting latency timer of device 0000:00:01.0 to 64 Nov 11 01:24:31 psql01 kernel: [ 0.560108] NET: Registered protocol family 2 Nov 11 01:24:31 psql01 kernel: [ 0.568139] IP route cache hash table entries: 16384 (order: 4, 65536 bytes) Nov 11 01:24:31 psql01 kernel: [ 0.576139] TCP established hash table entries: 65536 (order: 7, 524288 bytes) Nov 11 01:24:31 psql01 kernel: [ 0.580174] TCP bind hash table entries: 65536 (order: 7, 524288 bytes) Nov 11 01:24:31 psql01 kernel: [ 0.596132] TCP: Hash tables configured (established 65536 bind 65536) Nov 11 01:24:31 psql01 kernel: [ 0.596195] TCP reno registered Nov 11 01:24:31 psql01 kernel: [ 0.596404] NET: Registered protocol family 1 Nov 11 01:24:31 psql01 kernel: [ 0.600124] checking if image is initramfs... it is Nov 11 01:24:31 psql01 kernel: [ 1.048567] Switched to high resolution mode on CPU 0 Nov 11 01:24:31 psql01 kernel: [ 6.520106] Freeing initrd memory: 6024k freed Nov 11 01:24:31 psql01 kernel: [ 6.524252] Simple Boot Flag at 0x36 set to 0x1 Nov 11 01:24:31 psql01 kernel: [ 6.548658] audit: initializing netlink socket (disabled) Nov 11 01:24:31 psql01 kernel: [ 6.548736] type=2000 audit(1257873813.548:1): initialized Nov 11 01:24:31 psql01 kernel: [ 6.556375] Total HugeTLB memory allocated, 0 Nov 11 01:24:31 psql01 kernel: [ 6.556925] VFS: Disk quotas dquot_6.5.1 Nov 11 01:24:31 psql01 kernel: [ 6.557003] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes) Nov 11 01:24:31 psql01 kernel: [ 6.557082] msgmni has been set to 1007 Nov 11 01:24:31 psql01 kernel: [ 6.557408] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253) Nov 11 01:24:31 psql01 kernel: [ 6.557487] io scheduler noop registered Nov 11 01:24:31 psql01 kernel: [ 6.557563] io scheduler anticipatory registered Nov 11 01:24:31 psql01 kernel: [ 6.557594] io scheduler deadline registered Nov 11 01:24:31 psql01 kernel: [ 6.557672] io scheduler cfq registered (default) Nov 11 01:24:32 psql01 kernel: [ 6.557750] pci 0000:00:00.0: Limiting direct PCI/PCI transfers Nov 11 01:24:32 psql01 kernel: [ 6.557829] pci 0000:00:0f.0: Boot video device Nov 11 01:24:32 psql01 kernel: [ 6.564577] isapnp: Scanning for PnP cards... Nov 11 01:24:32 psql01 kernel: [ 6.925937] isapnp: No Plug & Play device found Nov 11 01:24:32 psql01 kernel: [ 6.962941] Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled Nov 11 01:24:32 psql01 kernel: [ 6.964105] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A Nov 11 01:24:32 psql01 kernel: [ 6.964376] serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Nov 11 01:24:32 psql01 kernel: [ 6.968043] 00:09: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A Nov 11 01:24:32 psql01 kernel: [ 6.968514] 00:0a: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A Nov 11 01:24:32 psql01 kernel: [ 6.996725] brd: module loaded Nov 11 01:24:32 psql01 kernel: [ 6.997197] PNP: PS/2 Controller [PNP0303:KBC,PNP0f13:MOUS] at 0x60,0x64 irq 1,12 Nov 11 01:24:32 psql01 kernel: [ 7.507935] serio: i8042 KBD port at 0x60,0x64 irq 1 Nov 11 01:24:32 psql01 kernel: [ 7.508018] serio: i8042 AUX port at 0x60,0x64 irq 12 Nov 11 01:24:32 psql01 kernel: [ 7.508018] mice: PS/2 mouse device common for all mice Nov 11 01:24:32 psql01 kernel: [ 7.508018] rtc_cmos 00:04: rtc core: registered rtc_cmos as rtc0 Nov 11 01:24:32 psql01 kernel: [ 7.508018] rtc0: alarms up to one month, y3k Nov 11 01:24:32 psql01 kernel: [ 7.508018] cpuidle: using governor ladder Nov 11 01:24:32 psql01 kernel: [ 7.508018] cpuidle: using governor menu Nov 11 01:24:32 psql01 kernel: [ 7.508018] No iBFT detected. Nov 11 01:24:32 psql01 kernel: [ 7.508682] TCP cubic registered Nov 11 01:24:32 psql01 kernel: [ 7.508734] NET: Registered protocol family 17 Nov 11 01:24:32 psql01 kernel: [ 7.508811] Using IPI No-Shortcut mode Nov 11 01:24:32 psql01 kernel: [ 7.509351] input: AT Translated Set 2 keyboard as /class/input/input0 Nov 11 01:24:32 psql01 kernel: [ 7.509688] registered taskstats version 1 Nov 11 01:24:32 psql01 kernel: [ 7.529979] rtc_cmos 00:04: setting system clock to 2009-11-10 17:23:42 UTC (1257873822) Nov 11 01:24:32 psql01 kernel: [ 7.572594] Freeing unused kernel memory: 244k freed Nov 11 01:24:32 psql01 kernel: [ 7.956560] ACPI: ACPI0007:00 is registered as cooling_device0 Nov 11 01:24:32 psql01 kernel: [ 7.956638] ACPI: Processor [CPU0] (supports 8 throttling states) Nov 11 01:24:32 psql01 kernel: [ 22.870180] Uniform Multi-Platform E-IDE driver Nov 11 01:24:32 psql01 kernel: [ 22.870294] ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx Nov 11 01:24:32 psql01 kernel: [ 23.325775] SCSI subsystem initialized Nov 11 01:24:32 psql01 kernel: [ 23.340676] pcnet32.c:v1.35 21.Apr.2008 tsbogend@alpha.franken.de Nov 11 01:24:32 psql01 kernel: [ 23.345297] ACPI: PCI Interrupt 0000:00:11.0[A] -> GSI 18 (level, low) -> IRQ 18 Nov 11 01:24:32 psql01 kernel: [ 23.349480] pcnet32: PCnet/PCI II 79C970A at 0x1400, 00:0c:29:46:70:ab assigned IRQ 18. Nov 11 01:24:32 psql01 kernel: [ 23.373402] eth0: registered as PCnet/PCI II 79C970A Nov 11 01:24:32 psql01 kernel: [ 23.376635] pcnet32: 1 cards_found. Nov 11 01:24:32 psql01 kernel: [ 23.381070] PIIX4: IDE controller (0x8086:0x7111 rev 0x01) at PCI slot 0000:00:07.1 Nov 11 01:24:32 psql01 kernel: [ 23.381575] PIIX4: not 100% native mode: will probe irqs later Nov 11 01:24:32 psql01 kernel: [ 23.384428] PIIX4: IDE port disabled Nov 11 01:24:32 psql01 kernel: [ 23.385232] ide0: BM-DMA at 0x1050-0x1057 Nov 11 01:24:32 psql01 kernel: [ 23.385729] Probing IDE interface ide0... Nov 11 01:24:32 psql01 kernel: [ 23.418002] Floppy drive(s): fd0 is 1.44M Nov 11 01:24:32 psql01 kernel: [ 23.442560] FDC 0 is a post-1991 82077 Nov 11 01:24:32 psql01 kernel: [ 23.451689] Fusion MPT base driver 3.04.06 Nov 11 01:24:32 psql01 kernel: [ 23.451711] Copyright (c) 1999-2007 LSI Corporation Nov 11 01:24:32 psql01 kernel: [ 23.465767] Fusion MPT SPI Host driver 3.04.06 Nov 11 01:24:32 psql01 kernel: [ 24.144937] hda: VMware Virtual IDE CDROM Drive, ATAPI CD/DVD-ROM drive Nov 11 01:24:32 psql01 kernel: [ 24.483068] hda: host max PIO4 wanted PIO255(auto-tune) selected PIO4 Nov 11 01:24:32 psql01 kernel: [ 24.489280] hda: UDMA/33 mode selected Nov 11 01:24:32 psql01 kernel: [ 24.491450] ide0 at 0x1f0-0x1f7,0x3f6 on irq 14 Nov 11 01:24:32 psql01 kernel: [ 24.500790] ACPI: PCI Interrupt 0000:00:10.0[A] -> GSI 17 (level, low) -> IRQ 17 Nov 11 01:24:32 psql01 kernel: [ 24.505275] mptbase: ioc0: Initiating bringup Nov 11 01:24:32 psql01 kernel: [ 24.578357] ioc0: LSI53C1030 B0: Capabilities={Initiator} Nov 11 01:24:32 psql01 kernel: [ 24.824304] scsi0 : ioc0: LSI53C1030 B0, FwRev=01032920h, Ports=1, MaxQ=128, IRQ=17 Nov 11 01:24:32 psql01 kernel: [ 24.961962] scsi 0:0:0:0: Direct-Access VMware Virtual disk 1.0 PQ: 0 ANSI: 2 Nov 11 01:24:32 psql01 kernel: [ 24.963431] target0:0:0: Beginning Domain Validation Nov 11 01:24:32 psql01 kernel: [ 24.966786] target0:0:0: Domain Validation skipping write tests Nov 11 01:24:32 psql01 kernel: [ 24.966828] target0:0:0: Ending Domain Validation Nov 11 01:24:32 psql01 kernel: [ 24.967264] target0:0:0: FAST-40 WIDE SCSI 80.0 MB/s ST (25 ns, offset 127) Nov 11 01:24:32 psql01 kernel: [ 24.985304] No dock devices found. Nov 11 01:24:32 psql01 kernel: [ 25.028111] libata version 3.00 loaded. Nov 11 01:24:32 psql01 kernel: [ 25.074806] Driver 'sd' needs updating - please use bus_type methods Nov 11 01:24:32 psql01 kernel: [ 25.075965] sd 0:0:0:0: [sda] 12582912 512-byte hardware sectors (6442 MB) Nov 11 01:24:32 psql01 kernel: [ 25.077390] sd 0:0:0:0: [sda] Test WP failed, assume Write Enabled Nov 11 01:24:32 psql01 kernel: [ 25.077568] sd 0:0:0:0: [sda] Cache data unavailable Nov 11 01:24:32 psql01 kernel: [ 25.077613] sd 0:0:0:0: [sda] Assuming drive cache: write through Nov 11 01:24:32 psql01 kernel: [ 25.079859] sd 0:0:0:0: [sda] 12582912 512-byte hardware sectors (6442 MB) Nov 11 01:24:32 psql01 kernel: [ 25.079981] sd 0:0:0:0: [sda] Test WP failed, assume Write Enabled Nov 11 01:24:32 psql01 kernel: [ 25.080022] sd 0:0:0:0: [sda] Cache data unavailable Nov 11 01:24:32 psql01 kernel: [ 25.080026] sd 0:0:0:0: [sda] Assuming drive cache: write through Nov 11 01:24:32 psql01 kernel: [ 25.080043] sda: sda1 sda2 sda3 Nov 11 01:24:32 psql01 kernel: [ 25.116818] hda: ATAPI 1X CD-ROM drive, 32kB Cache Nov 11 01:24:32 psql01 kernel: [ 25.117006] Uniform CD-ROM driver Revision: 3.20 Nov 11 01:24:32 psql01 kernel: [ 25.126124] sd 0:0:0:0: [sda] Attached SCSI disk Nov 11 01:24:32 psql01 kernel: [ 25.968647] PM: Starting manual resume from disk Nov 11 01:24:32 psql01 kernel: [ 26.046000] EXT3-fs: INFO: recovery required on readonly filesystem. Nov 11 01:24:32 psql01 kernel: [ 26.046035] EXT3-fs: write access will be enabled during recovery. Nov 11 01:24:32 psql01 kernel: [ 38.205660] kjournald starting. Commit interval 5 seconds Nov 11 01:24:32 psql01 kernel: [ 38.205660] EXT3-fs: recovery complete. Nov 11 01:24:32 psql01 kernel: [ 38.205660] EXT3-fs: mounted filesystem with ordered data mode. Nov 11 01:24:32 psql01 kernel: [ 44.188868] udevd version 125 started Nov 11 01:24:32 psql01 kernel: [ 47.659657] Linux agpgart interface v0.103 Nov 11 01:24:32 psql01 kernel: [ 48.767887] agpgart: Detected an Intel 440BX Chipset. Nov 11 01:24:32 psql01 kernel: [ 48.772023] agpgart: AGP aperture is 256M @ 0x0 Nov 11 01:24:32 psql01 kernel: [ 48.832116] input: Power Button (FF) as /class/input/input1 Nov 11 01:24:32 psql01 kernel: [ 48.927108] ACPI: Power Button (FF) [PWRF] Nov 11 01:24:32 psql01 kernel: [ 49.295599] ACPI: AC Adapter [ACAD] (on-line) Nov 11 01:24:32 psql01 kernel: [ 50.335855] piix4_smbus 0000:00:07.3: Found 0000:00:07.3 device Nov 11 01:24:32 psql01 kernel: [ 50.336212] piix4_smbus 0000:00:07.3: Host SMBus controller not enabled! Nov 11 01:24:32 psql01 kernel: [ 50.350855] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 Nov 11 01:24:32 psql01 kernel: [ 50.360748] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Nov 11 01:24:32 psql01 kernel: [ 50.459448] input: ImPS/2 Generic Wheel Mouse as /class/input/input2 Nov 11 01:24:32 psql01 kernel: [ 50.554142] input: PC Speaker as /class/input/input3 Nov 11 01:24:32 psql01 kernel: [ 50.787846] Error: Driver 'pcspkr' is already registered, aborting... Nov 11 01:24:32 psql01 kernel: [ 50.814638] parport_pc 00:08: reported by Plug and Play ACPI Nov 11 01:24:32 psql01 kernel: [ 50.815516] parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE] Nov 11 01:24:32 psql01 kernel: [ 53.832172] Adding 248996k swap on /dev/sda2. Priority:-1 extents:1 across:248996k Nov 11 01:24:32 psql01 kernel: [ 54.889734] EXT3 FS on sda1, internal journal Nov 11 01:24:32 psql01 kernel: [ 55.108401] loop: module loaded Nov 11 01:24:32 psql01 kernel: [ 56.765761] fuse init (API version 7.9) Nov 11 01:24:32 psql01 kernel: [ 57.816030] eth0: link up Nov 11 01:24:33 psql01 stonithd: [1751]: info: init_ais_connection: AIS connection established Nov 11 01:24:33 psql01 corosync[1719]: [pcmk ] info: pcmk_ipc: Recorded connection 0x8e31468 for stonithd/1751 Nov 11 01:24:33 psql01 stonithd: [1751]: info: get_ais_nodeid: Server details: id=372597770 uname=psql01 Nov 11 01:24:33 psql01 stonithd: [1751]: info: crm_new_peer: Node psql01 now has id: 372597770 Nov 11 01:24:33 psql01 stonithd: [1751]: info: crm_new_peer: Node 372597770 is now known as psql01 Nov 11 01:24:33 psql01 stonithd: [1751]: notice: /usr/lib/heartbeat/stonithd start up successfully. Nov 11 01:24:33 psql01 stonithd: [1751]: info: G_main_add_SignalHandler: Added signal handler for signal 17 Nov 11 01:24:33 psql01 /usr/sbin/cron[1812]: (CRON) INFO (pidfile fd = 3) Nov 11 01:24:33 psql01 /usr/sbin/cron[1813]: (CRON) STARTUP (fork ok) Nov 11 01:24:33 psql01 /usr/sbin/cron[1813]: (CRON) INFO (Running @reboot jobs) Nov 11 01:24:33 psql01 logd: [1822]: info: logd started with default configuration. Nov 11 01:24:33 psql01 logd: [1823]: info: G_main_add_SignalHandler: Added signal handler for signal 15 Nov 11 01:24:33 psql01 logd: [1822]: info: G_main_add_SignalHandler: Added signal handler for signal 15 Nov 11 01:24:34 psql01 attrd: [1754]: info: cib_connect: Connected to the CIB after 1 signon attempts Nov 11 01:24:34 psql01 attrd: [1754]: info: cib_connect: Sending full refresh Nov 11 01:24:38 psql01 kernel: [ 71.131273] NET: Registered protocol family 10 Nov 11 01:24:38 psql01 kernel: [ 71.139773] lo: Disabled Privacy Extensions Nov 11 01:24:49 psql01 kernel: [ 82.557970] eth0: no IPv6 routers present Nov 11 01:25:19 psql01 crmd: [1756]: info: do_election_count_vote: Election 2 (owner: psql02) pass: vote from psql02 (Host name) Nov 11 01:25:19 psql01 crmd: [1756]: info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_ELECTION cause=C_FSA_INTERNAL origin=do_election_count_vote ] Nov 11 01:25:19 psql01 crmd: [1756]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] Nov 11 01:25:19 psql01 crmd: [1756]: info: do_te_control: Registering TE UUID: b3f6f6c3-0d0f-42a7-b357-36c601930ddf Nov 11 01:25:19 psql01 crmd: [1756]: WARN: cib_client_add_notify_callback: Callback already present Nov 11 01:25:19 psql01 crmd: [1756]: info: set_graph_functions: Setting custom graph functions Nov 11 01:25:19 psql01 crmd: [1756]: info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses Nov 11 01:25:19 psql01 crmd: [1756]: info: do_dc_takeover: Taking over DC status for this partition Nov 11 01:25:19 psql01 cib: [1752]: info: cib_process_readwrite: We are now in R/W mode Nov 11 01:25:19 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/6, version=0.780.0): ok (rc=0) Nov 11 01:25:19 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/7, version=0.780.0): ok (rc=0) Nov 11 01:25:19 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/9, version=0.780.0): ok (rc=0) Nov 11 01:25:19 psql01 crmd: [1756]: info: join_make_offer: Making join offers based on membership 112 Nov 11 01:25:19 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/11, version=0.780.0): ok (rc=0) Nov 11 01:25:19 psql01 crmd: [1756]: info: do_dc_join_offer_all: join-1: Waiting on 2 outstanding join acks Nov 11 01:25:19 psql01 crmd: [1756]: info: ais_dispatch: Membership 112: quorum retained Nov 11 01:25:19 psql01 crmd: [1756]: info: config_query_callback: Checking for expired actions every 900000ms Nov 11 01:25:19 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/14, version=0.780.0): ok (rc=0) Nov 11 01:25:19 psql01 crmd: [1756]: info: update_dc: Set DC to psql01 (3.0.1) Nov 11 01:25:19 psql01 crmd: [1756]: info: ais_dispatch: Membership 112: quorum retained Nov 11 01:25:19 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/17, version=0.780.0): ok (rc=0) Nov 11 01:25:19 psql01 crmd: [1756]: info: te_connect_stonith: Attempting connection to fencing daemon... Nov 11 01:25:20 psql01 crmd: [1756]: info: te_connect_stonith: Connected Nov 11 01:25:20 psql01 crmd: [1756]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] Nov 11 01:25:20 psql01 crmd: [1756]: info: do_state_transition: All 2 cluster nodes responded to the join offer. Nov 11 01:25:20 psql01 crmd: [1756]: info: do_dc_join_finalize: join-1: Syncing the CIB from psql02 to the rest of the cluster Nov 11 01:25:20 psql01 cib: [1752]: info: cib_replace_notify: Local-only Replace: 0.781.0 from psql02 Nov 11 01:25:20 psql01 cib: [1752]: info: log_data_element: cib:diff: - Nov 11 01:25:20 psql01 cib: [1752]: info: log_data_element: cib:diff: + Nov 11 01:25:20 psql01 attrd: [1754]: info: do_cib_replaced: Sending full refresh Nov 11 01:25:20 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/19, version=0.781.0): ok (rc=0) Nov 11 01:25:20 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/20, version=0.781.0): ok (rc=0) Nov 11 01:25:20 psql01 crmd: [1756]: info: update_attrd: Connecting to attrd... Nov 11 01:25:20 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='psql01']/transient_attributes (origin=local/crmd/21, version=0.781.0): ok (rc=0) Nov 11 01:25:21 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='psql01']/lrm (origin=local/crmd/22, version=0.781.0): ok (rc=0) Nov 11 01:25:21 psql01 attrd: [1754]: info: find_hash_entry: Creating hash entry for terminate Nov 11 01:25:21 psql01 attrd: [1754]: info: find_hash_entry: Creating hash entry for shutdown Nov 11 01:25:21 psql01 crmd: [1756]: info: erase_xpath_callback: Deletion of "//node_state[@uname='psql01']/transient_attributes": ok (rc=0) Nov 11 01:25:21 psql01 attrd: [1754]: info: crm_new_peer: Node psql02 now has id: 389374986 Nov 11 01:25:21 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='psql02']/transient_attributes (origin=psql02/crmd/8, version=0.781.0): ok (rc=0) Nov 11 01:25:21 psql01 crmd: [1756]: info: erase_xpath_callback: Deletion of "//node_state[@uname='psql01']/lrm": ok (rc=0) Nov 11 01:25:21 psql01 attrd: [1754]: info: crm_new_peer: Node 389374986 is now known as psql02 Nov 11 01:25:21 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='psql02']/lrm (origin=psql02/crmd/9, version=0.781.0): ok (rc=0) Nov 11 01:25:21 psql01 cib: [2150]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-35.raw Nov 11 01:25:21 psql01 crmd: [1756]: info: do_dc_join_ack: join-1: Updating node state to member for psql02 Nov 11 01:25:21 psql01 crmd: [1756]: info: do_dc_join_ack: join-1: Updating node state to member for psql01 Nov 11 01:25:21 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='psql02']/lrm (origin=local/crmd/23, version=0.781.0): ok (rc=0) Nov 11 01:25:21 psql01 cib: [2150]: info: write_cib_contents: Wrote version 0.781.0 of the CIB to disk (digest: 264ae8fe9128d4064d2cf4c96001bee2) Nov 11 01:25:21 psql01 crmd: [1756]: info: erase_xpath_callback: Deletion of "//node_state[@uname='psql02']/lrm": ok (rc=0) Nov 11 01:25:21 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='psql01']/lrm (origin=local/crmd/25, version=0.781.1): ok (rc=0) Nov 11 01:25:21 psql01 crmd: [1756]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] Nov 11 01:25:21 psql01 crmd: [1756]: info: do_state_transition: All 2 cluster nodes are eligible to run resources. Nov 11 01:25:21 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/27, version=0.781.2): ok (rc=0) Nov 11 01:25:21 psql01 crmd: [1756]: info: do_dc_join_final: Ensuring DC, quorum and node attributes are up-to-date Nov 11 01:25:21 psql01 cib: [2150]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.NIU12o (digest: /var/lib/heartbeat/crm/cib.e48zXu) Nov 11 01:25:21 psql01 crmd: [1756]: info: crm_update_quorum: Updating quorum status to true (call=29) Nov 11 01:25:21 psql01 attrd: [1754]: info: attrd_local_callback: Sending full refresh (origin=crmd) Nov 11 01:25:21 psql01 cib: [1752]: info: log_data_element: cib:diff: - Nov 11 01:25:21 psql01 crmd: [1756]: info: abort_transition_graph: do_te_invoke:191 - Triggered transition abort (complete=1) : Peer Cancelled Nov 11 01:25:21 psql01 attrd: [1754]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate () Nov 11 01:25:21 psql01 cib: [1752]: info: log_data_element: cib:diff: + Nov 11 01:25:21 psql01 crmd: [1756]: info: do_pe_invoke: Query 30: Requesting the current CIB: S_POLICY_ENGINE Nov 11 01:25:21 psql01 crmd: [1756]: info: erase_xpath_callback: Deletion of "//node_state[@uname='psql01']/lrm": ok (rc=0) Nov 11 01:25:21 psql01 cib: [1752]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/29, version=0.782.1): ok (rc=0) Nov 11 01:25:21 psql01 crmd: [1756]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change Nov 11 01:25:21 psql01 attrd: [1754]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown () Nov 11 01:25:21 psql01 crmd: [1756]: info: need_abort: Aborting on change to have-quorum Nov 11 01:25:21 psql01 crmd: [1756]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1257873921-9, seq=112, quorate=1 Nov 11 01:25:21 psql01 crmd: [1756]: info: do_pe_invoke: Query 31: Requesting the current CIB: S_POLICY_ENGINE Nov 11 01:25:21 psql01 pengine: [1755]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 11 01:25:21 psql01 crmd: [1756]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1257873921-10, seq=112, quorate=1 Nov 11 01:25:21 psql01 cib: [2151]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-36.raw Nov 11 01:25:21 psql01 pengine: [1755]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0 Nov 11 01:25:21 psql01 pengine: [1755]: info: determine_online_status: Node psql02 is online Nov 11 01:25:21 psql01 pengine: [1755]: info: determine_online_status: Node psql01 is online Nov 11 01:25:21 psql01 pengine: [1755]: notice: clone_print: Clone Set: fencing Nov 11 01:25:21 psql01 pengine: [1755]: notice: short_print: Stopped: [ st-ssh:0 st-ssh:1 ] Nov 11 01:25:21 psql01 pengine: [1755]: notice: native_print: failover-psql#011(lsb:postgresql-8.3):#011Stopped Nov 11 01:25:21 psql01 pengine: [1755]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Stopped Nov 11 01:25:21 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (30s) for failover-psql on psql01 Nov 11 01:25:21 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (5s) for failover-ip on psql01 Nov 11 01:25:21 psql01 pengine: [1755]: notice: LogActions: Start st-ssh:0#011(psql01) Nov 11 01:25:21 psql01 pengine: [1755]: notice: LogActions: Start st-ssh:1#011(psql02) Nov 11 01:25:21 psql01 pengine: [1755]: notice: LogActions: Start failover-psql#011(psql01) Nov 11 01:25:21 psql01 pengine: [1755]: notice: LogActions: Start failover-ip#011(psql01) Nov 11 01:25:21 psql01 crmd: [1756]: info: handle_response: pe_calc calculation pe_calc-dc-1257873921-9 is obsolete Nov 11 01:25:21 psql01 cib: [2151]: info: write_cib_contents: Wrote version 0.782.0 of the CIB to disk (digest: 718ca1e2438293160032b66138aac6bf) Nov 11 01:25:21 psql01 pengine: [1755]: info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/pengine/pe-input-52.bz2 Nov 11 01:25:21 psql01 pengine: [1755]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 11 01:25:21 psql01 pengine: [1755]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0 Nov 11 01:25:21 psql01 pengine: [1755]: info: determine_online_status: Node psql02 is online Nov 11 01:25:21 psql01 pengine: [1755]: info: determine_online_status: Node psql01 is online Nov 11 01:25:21 psql01 pengine: [1755]: notice: clone_print: Clone Set: fencing Nov 11 01:25:21 psql01 pengine: [1755]: notice: short_print: Stopped: [ st-ssh:0 st-ssh:1 ] Nov 11 01:25:21 psql01 pengine: [1755]: notice: native_print: failover-psql#011(lsb:postgresql-8.3):#011Stopped Nov 11 01:25:21 psql01 pengine: [1755]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Stopped Nov 11 01:25:21 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (30s) for failover-psql on psql01 Nov 11 01:25:21 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (5s) for failover-ip on psql01 Nov 11 01:25:21 psql01 pengine: [1755]: notice: LogActions: Start st-ssh:0#011(psql01) Nov 11 01:25:21 psql01 pengine: [1755]: notice: LogActions: Start st-ssh:1#011(psql02) Nov 11 01:25:21 psql01 pengine: [1755]: notice: LogActions: Start failover-psql#011(psql01) Nov 11 01:25:21 psql01 pengine: [1755]: notice: LogActions: Start failover-ip#011(psql01) Nov 11 01:25:21 psql01 crmd: [1756]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] Nov 11 01:25:21 psql01 crmd: [1756]: info: unpack_graph: Unpacked transition 1: 18 actions in 18 synapses Nov 11 01:25:21 psql01 crmd: [1756]: info: do_te_invoke: Processing graph 1 (ref=pe_calc-dc-1257873921-10) derived from /var/lib/pengine/pe-input-53.bz2 Nov 11 01:25:21 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 4: monitor st-ssh:0_monitor_0 on psql01 (local) Nov 11 01:25:22 psql01 lrmd: [1753]: notice: lrmd_rsc_new(): No lrm_rprovider field in message Nov 11 01:25:23 psql01 crmd: [1756]: info: do_lrm_rsc_op: Performing key=4:1:7:b3f6f6c3-0d0f-42a7-b357-36c601930ddf op=st-ssh:0_monitor_0 ) Nov 11 01:25:23 psql01 lrmd: [1753]: info: rsc:st-ssh:0:2: monitor Nov 11 01:25:23 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 8: monitor st-ssh:1_monitor_0 on psql02 Nov 11 01:25:23 psql01 cib: [2151]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.mX2v0p (digest: /var/lib/heartbeat/crm/cib.CJjySw) Nov 11 01:25:23 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 5: monitor failover-psql_monitor_0 on psql01 (local) Nov 11 01:25:23 psql01 lrmd: [1753]: notice: lrmd_rsc_new(): No lrm_rprovider field in message Nov 11 01:25:23 psql01 crmd: [1756]: info: do_lrm_rsc_op: Performing key=5:1:7:b3f6f6c3-0d0f-42a7-b357-36c601930ddf op=failover-psql_monitor_0 ) Nov 11 01:25:23 psql01 lrmd: [1753]: info: rsc:failover-psql:3: monitor Nov 11 01:25:23 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 9: monitor failover-psql_monitor_0 on psql02 Nov 11 01:25:23 psql01 pengine: [1755]: info: process_pe_message: Transition 1: PEngine Input stored in: /var/lib/pengine/pe-input-53.bz2 Nov 11 01:25:23 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 6: monitor failover-ip_monitor_0 on psql01 (local) Nov 11 01:25:23 psql01 crmd: [1756]: info: do_lrm_rsc_op: Performing key=6:1:7:b3f6f6c3-0d0f-42a7-b357-36c601930ddf op=failover-ip_monitor_0 ) Nov 11 01:25:23 psql01 lrmd: [1753]: info: rsc:failover-ip:4: monitor Nov 11 01:25:23 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 10: monitor failover-ip_monitor_0 on psql02 Nov 11 01:25:23 psql01 crmd: [1756]: info: match_graph_event: Action st-ssh:1_monitor_0 (8) confirmed on psql02 (rc=0) Nov 11 01:25:23 psql01 crmd: [1756]: info: process_lrm_event: LRM operation st-ssh:0_monitor_0 (call=2, rc=7, cib-update=32, confirmed=true) not running Nov 11 01:25:23 psql01 crmd: [1756]: info: match_graph_event: Action st-ssh:0_monitor_0 (4) confirmed on psql01 (rc=0) Nov 11 01:25:24 psql01 crmd: [1756]: info: match_graph_event: Action failover-psql_monitor_0 (9) confirmed on psql02 (rc=0) Nov 11 01:25:24 psql01 crmd: [1756]: info: match_graph_event: Action failover-ip_monitor_0 (10) confirmed on psql02 (rc=0) Nov 11 01:25:24 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 7: probe_complete probe_complete on psql02 - no waiting Nov 11 01:25:24 psql01 attrd: [1754]: info: find_hash_entry: Creating hash entry for probe_complete Nov 11 01:25:24 psql01 crmd: [1756]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=psql02, magic=NA, cib=0.782.6) : Transient attribute: update Nov 11 01:25:24 psql01 crmd: [1756]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000 Nov 11 01:25:24 psql01 crmd: [1756]: info: update_abort_priority: Abort action done superceeded by restart Nov 11 01:25:24 psql01 crmd: [1756]: info: process_lrm_event: LRM operation failover-ip_monitor_0 (call=4, rc=7, cib-update=33, confirmed=true) not running Nov 11 01:25:24 psql01 crmd: [1756]: info: match_graph_event: Action failover-ip_monitor_0 (6) confirmed on psql01 (rc=0) Nov 11 01:25:25 psql01 crmd: [1756]: info: process_lrm_event: LRM operation failover-psql_monitor_0 (call=3, rc=7, cib-update=34, confirmed=true) not running Nov 11 01:25:25 psql01 crmd: [1756]: info: match_graph_event: Action failover-psql_monitor_0 (5) confirmed on psql01 (rc=0) Nov 11 01:25:25 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 3: probe_complete probe_complete on psql01 (local) - no waiting Nov 11 01:25:25 psql01 crmd: [1756]: info: run_graph: ==================================================== Nov 11 01:25:25 psql01 crmd: [1756]: notice: run_graph: Transition 1 (Complete=8, Pending=0, Fired=0, Skipped=9, Incomplete=1, Source=/var/lib/pengine/pe-input-53.bz2): Stopped Nov 11 01:25:25 psql01 crmd: [1756]: info: te_graph_trigger: Transition 1 is now complete Nov 11 01:25:25 psql01 crmd: [1756]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ] Nov 11 01:25:25 psql01 crmd: [1756]: info: do_state_transition: All 2 cluster nodes are eligible to run resources. Nov 11 01:25:25 psql01 crmd: [1756]: info: do_pe_invoke: Query 35: Requesting the current CIB: S_POLICY_ENGINE Nov 11 01:25:25 psql01 attrd: [1754]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true) Nov 11 01:25:25 psql01 crmd: [1756]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1257873925-19, seq=112, quorate=1 Nov 11 01:25:25 psql01 pengine: [1755]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 11 01:25:25 psql01 attrd: [1754]: info: attrd_perform_update: Sent update 11: probe_complete=true Nov 11 01:25:25 psql01 crmd: [1756]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=psql01, magic=NA, cib=0.782.9) : Transient attribute: update Nov 11 01:25:25 psql01 pengine: [1755]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0 Nov 11 01:25:25 psql01 crmd: [1756]: info: do_pe_invoke: Query 36: Requesting the current CIB: S_POLICY_ENGINE Nov 11 01:25:25 psql01 pengine: [1755]: info: determine_online_status: Node psql02 is online Nov 11 01:25:25 psql01 crmd: [1756]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1257873925-20, seq=112, quorate=1 Nov 11 01:25:25 psql01 pengine: [1755]: info: determine_online_status: Node psql01 is online Nov 11 01:25:25 psql01 pengine: [1755]: notice: clone_print: Clone Set: fencing Nov 11 01:25:25 psql01 pengine: [1755]: notice: short_print: Stopped: [ st-ssh:0 st-ssh:1 ] Nov 11 01:25:25 psql01 pengine: [1755]: notice: native_print: failover-psql#011(lsb:postgresql-8.3):#011Stopped Nov 11 01:25:25 psql01 pengine: [1755]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Stopped Nov 11 01:25:25 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (30s) for failover-psql on psql01 Nov 11 01:25:25 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (5s) for failover-ip on psql01 Nov 11 01:25:25 psql01 pengine: [1755]: notice: LogActions: Start st-ssh:0#011(psql01) Nov 11 01:25:25 psql01 pengine: [1755]: notice: LogActions: Start st-ssh:1#011(psql02) Nov 11 01:25:25 psql01 pengine: [1755]: notice: LogActions: Start failover-psql#011(psql01) Nov 11 01:25:25 psql01 pengine: [1755]: notice: LogActions: Start failover-ip#011(psql01) Nov 11 01:25:25 psql01 crmd: [1756]: info: handle_response: pe_calc calculation pe_calc-dc-1257873925-19 is obsolete Nov 11 01:25:25 psql01 pengine: [1755]: info: process_pe_message: Transition 2: PEngine Input stored in: /var/lib/pengine/pe-input-54.bz2 Nov 11 01:25:25 psql01 pengine: [1755]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 11 01:25:25 psql01 pengine: [1755]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0 Nov 11 01:25:25 psql01 pengine: [1755]: info: determine_online_status: Node psql02 is online Nov 11 01:25:25 psql01 pengine: [1755]: info: determine_online_status: Node psql01 is online Nov 11 01:25:25 psql01 pengine: [1755]: notice: clone_print: Clone Set: fencing Nov 11 01:25:25 psql01 pengine: [1755]: notice: short_print: Stopped: [ st-ssh:0 st-ssh:1 ] Nov 11 01:25:25 psql01 pengine: [1755]: notice: native_print: failover-psql#011(lsb:postgresql-8.3):#011Stopped Nov 11 01:25:25 psql01 pengine: [1755]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Stopped Nov 11 01:25:25 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (30s) for failover-psql on psql01 Nov 11 01:25:25 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (5s) for failover-ip on psql01 Nov 11 01:25:25 psql01 pengine: [1755]: notice: LogActions: Start st-ssh:0#011(psql01) Nov 11 01:25:25 psql01 pengine: [1755]: notice: LogActions: Start st-ssh:1#011(psql02) Nov 11 01:25:25 psql01 pengine: [1755]: notice: LogActions: Start failover-psql#011(psql01) Nov 11 01:25:26 psql01 pengine: [1755]: notice: LogActions: Start failover-ip#011(psql01) Nov 11 01:25:26 psql01 crmd: [1756]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] Nov 11 01:25:26 psql01 crmd: [1756]: info: unpack_graph: Unpacked transition 3: 8 actions in 8 synapses Nov 11 01:25:26 psql01 crmd: [1756]: info: do_te_invoke: Processing graph 3 (ref=pe_calc-dc-1257873925-20) derived from /var/lib/pengine/pe-input-55.bz2 Nov 11 01:25:26 psql01 crmd: [1756]: info: te_pseudo_action: Pseudo action 7 fired and confirmed Nov 11 01:25:26 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 13: start failover-ip_start_0 on psql01 (local) Nov 11 01:25:26 psql01 crmd: [1756]: info: do_lrm_rsc_op: Performing key=13:3:0:b3f6f6c3-0d0f-42a7-b357-36c601930ddf op=failover-ip_start_0 ) Nov 11 01:25:26 psql01 lrmd: [1753]: info: rsc:failover-ip:5: start Nov 11 01:25:26 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 5: start st-ssh:0_start_0 on psql01 (local) Nov 11 01:25:26 psql01 crmd: [1756]: info: do_lrm_rsc_op: Performing key=5:3:0:b3f6f6c3-0d0f-42a7-b357-36c601930ddf op=st-ssh:0_start_0 ) Nov 11 01:25:26 psql01 lrmd: [1753]: info: rsc:st-ssh:0:6: start Nov 11 01:25:26 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 6: start st-ssh:1_start_0 on psql02 Nov 11 01:25:26 psql01 lrmd: [2191]: info: Try to start STONITH resource : Device=external/ssh Nov 11 01:25:26 psql01 IPaddr[2166]: INFO: Using calculated nic for 10.100.53.100: eth0 Nov 11 01:25:26 psql01 pengine: [1755]: info: process_pe_message: Transition 3: PEngine Input stored in: /var/lib/pengine/pe-input-55.bz2 Nov 11 01:25:26 psql01 lrmd: [1753]: info: RA output: (failover-ip:start:stderr) 2009/11/11_01:25:26 INFO: Using calculated nic for 10.100.53.100: eth0 Nov 11 01:25:26 psql01 IPaddr[2166]: INFO: Using calculated netmask for 10.100.53.100: 255.255.255.255 Nov 11 01:25:26 psql01 lrmd: [1753]: info: RA output: (failover-ip:start:stderr) 2009/11/11_01:25:26 INFO: Using calculated netmask for 10.100.53.100: 255.255.255.255 Nov 11 01:25:26 psql01 crmd: [1756]: info: match_graph_event: Action st-ssh:1_start_0 (6) confirmed on psql02 (rc=0) Nov 11 01:25:26 psql01 IPaddr[2166]: INFO: eval ifconfig eth0:0 10.100.53.100 netmask 255.255.255.255 broadcast 10.100.53.100 Nov 11 01:25:26 psql01 lrmd: [1753]: info: RA output: (failover-ip:start:stderr) 2009/11/11_01:25:26 INFO: eval ifconfig eth0:0 10.100.53.100 netmask 255.255.255.255 broadcast 10.100.53.100 Nov 11 01:25:26 psql01 crmd: [1756]: info: process_lrm_event: LRM operation failover-ip_start_0 (call=5, rc=0, cib-update=37, confirmed=true) ok Nov 11 01:25:26 psql01 crmd: [1756]: info: match_graph_event: Action failover-ip_start_0 (13) confirmed on psql01 (rc=0) Nov 11 01:25:26 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 11: start failover-psql_start_0 on psql01 (local) Nov 11 01:25:26 psql01 crmd: [1756]: info: do_lrm_rsc_op: Performing key=11:3:0:b3f6f6c3-0d0f-42a7-b357-36c601930ddf op=failover-psql_start_0 ) Nov 11 01:25:26 psql01 lrmd: [1753]: info: rsc:failover-psql:7: start Nov 11 01:25:26 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 14: monitor failover-ip_monitor_5000 on psql01 (local) Nov 11 01:25:26 psql01 lrmd: [2256]: WARN: For LSB init script, no additional parameters are needed. Nov 11 01:25:27 psql01 crmd: [1756]: info: do_lrm_rsc_op: Performing key=14:3:0:b3f6f6c3-0d0f-42a7-b357-36c601930ddf op=failover-ip_monitor_5000 ) Nov 11 01:25:27 psql01 lrmd: [1753]: info: RA output: (failover-psql:start:stdout) Starting PostgreSQL 8.3 database server: Nov 11 01:25:27 psql01 lrmd: [1753]: info: RA output: (failover-psql:start:stdout) main Nov 11 01:25:27 psql01 crmd: [1756]: info: process_lrm_event: LRM operation failover-ip_monitor_5000 (call=8, rc=0, cib-update=38, confirmed=false) ok Nov 11 01:25:27 psql01 crmd: [1756]: info: match_graph_event: Action failover-ip_monitor_5000 (14) confirmed on psql01 (rc=0) Nov 11 01:25:30 psql01 stonithd: [1751]: WARN: G_SIG_dispatch: Dispatch function for SIGCHLD was delayed 390 ms (> 100 ms) before being called (GSource: 0x8c89ef0) Nov 11 01:25:30 psql01 stonithd: [1751]: info: G_SIG_dispatch: started at 1718076672 should have started at 1718076633 Nov 11 01:25:30 psql01 lrmd: [1753]: debug: stonithRA plugin: provider attribute is not needed and will be ignored. Nov 11 01:25:30 psql01 crmd: [1756]: info: process_lrm_event: LRM operation st-ssh:0_start_0 (call=6, rc=0, cib-update=39, confirmed=true) ok Nov 11 01:25:30 psql01 crmd: [1756]: info: match_graph_event: Action st-ssh:0_start_0 (5) confirmed on psql01 (rc=0) Nov 11 01:25:30 psql01 crmd: [1756]: info: te_pseudo_action: Pseudo action 8 fired and confirmed Nov 11 01:25:30 psql01 stonithd: [1751]: info: st-ssh:0 stonith resource started Nov 11 01:25:44 psql01 lrmd: [1753]: info: RA output: (failover-psql:start:stdout) . Nov 11 01:25:44 psql01 crmd: [1756]: info: process_lrm_event: LRM operation failover-psql_start_0 (call=7, rc=0, cib-update=40, confirmed=true) ok Nov 11 01:25:44 psql01 crmd: [1756]: info: match_graph_event: Action failover-psql_start_0 (11) confirmed on psql01 (rc=0) Nov 11 01:25:44 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 12: monitor failover-psql_monitor_30000 on psql01 (local) Nov 11 01:25:44 psql01 crmd: [1756]: info: do_lrm_rsc_op: Performing key=12:3:0:b3f6f6c3-0d0f-42a7-b357-36c601930ddf op=failover-psql_monitor_30000 ) Nov 11 01:25:44 psql01 crmd: [1756]: info: process_lrm_event: LRM operation failover-psql_monitor_30000 (call=9, rc=0, cib-update=41, confirmed=false) ok Nov 11 01:25:44 psql01 crmd: [1756]: info: match_graph_event: Action failover-psql_monitor_30000 (12) confirmed on psql01 (rc=0) Nov 11 01:25:44 psql01 crmd: [1756]: info: run_graph: ==================================================== Nov 11 01:25:44 psql01 crmd: [1756]: notice: run_graph: Transition 3 (Complete=8, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-55.bz2): Complete Nov 11 01:25:44 psql01 crmd: [1756]: info: te_graph_trigger: Transition 3 is now complete Nov 11 01:25:44 psql01 crmd: [1756]: info: notify_crmd: Transition 3 status: done - Nov 11 01:25:44 psql01 crmd: [1756]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] Nov 11 01:25:44 psql01 crmd: [1756]: info: do_state_transition: Starting PEngine Recheck Timer Nov 11 01:27:34 psql01 pengine: [2582]: info: crm_log_init: Changed active directory to /var/lib/heartbeat/cores/root Nov 11 01:27:34 psql01 pengine: [2582]: info: Invoked: /usr/lib/heartbeat/pengine metadata Nov 11 01:27:34 psql01 crm_shadow: [2585]: info: Invoked: crm_shadow Nov 11 01:27:34 psql01 crm_shadow: [2587]: info: Invoked: crm_shadow Nov 11 01:27:34 psql01 crm_shadow: [2589]: info: Invoked: crm_shadow Nov 11 01:27:34 psql01 cibadmin: [2590]: info: Invoked: cibadmin -Ql Nov 11 01:27:45 psql01 crmd: [1756]: info: process_lrm_event: LRM operation failover-psql_monitor_30000 (call=9, rc=7, cib-update=42, confirmed=false) not running Nov 11 01:27:45 psql01 crmd: [1756]: info: process_graph_event: Action failover-psql_monitor_30000 arrived after a completed transition Nov 11 01:27:45 psql01 crmd: [1756]: info: abort_transition_graph: process_graph_event:467 - Triggered transition abort (complete=1, tag=lrm_rsc_op, id=failover-psql_monitor_30000, magic=0:7;12:3:0:b3f6f6c3-0d0f-42a7-b357-36c601930ddf, cib=0.782.16) : Inactive graph Nov 11 01:27:45 psql01 crmd: [1756]: WARN: update_failcount: Updating failcount for failover-psql on psql01 after failed monitor: rc=7 (update=value++, time=1257874065) Nov 11 01:27:45 psql01 crmd: [1756]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=abort_transition_graph ] Nov 11 01:27:45 psql01 crmd: [1756]: info: do_state_transition: All 2 cluster nodes are eligible to run resources. Nov 11 01:27:45 psql01 crmd: [1756]: info: do_pe_invoke: Query 43: Requesting the current CIB: S_POLICY_ENGINE Nov 11 01:27:45 psql01 attrd: [1754]: info: find_hash_entry: Creating hash entry for fail-count-failover-psql Nov 11 01:27:45 psql01 attrd: [1754]: info: attrd_local_callback: Expanded fail-count-failover-psql=value++ to 1 Nov 11 01:27:45 psql01 attrd: [1754]: info: attrd_trigger_update: Sending flush op to all hosts for: fail-count-failover-psql (1) Nov 11 01:27:45 psql01 crmd: [1756]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1257874065-27, seq=112, quorate=1 Nov 11 01:27:45 psql01 pengine: [1755]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 11 01:27:45 psql01 attrd: [1754]: info: attrd_perform_update: Sent update 14: fail-count-failover-psql=1 Nov 11 01:27:45 psql01 crmd: [1756]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=psql01, magic=NA, cib=0.782.17) : Transient attribute: update Nov 11 01:27:45 psql01 pengine: [1755]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0 Nov 11 01:27:45 psql01 attrd: [1754]: info: find_hash_entry: Creating hash entry for last-failure-failover-psql Nov 11 01:27:45 psql01 crmd: [1756]: info: do_pe_invoke: Query 44: Requesting the current CIB: S_POLICY_ENGINE Nov 11 01:27:45 psql01 pengine: [1755]: info: determine_online_status: Node psql02 is online Nov 11 01:27:45 psql01 attrd: [1754]: info: attrd_trigger_update: Sending flush op to all hosts for: last-failure-failover-psql (1257874065) Nov 11 01:27:45 psql01 crmd: [1756]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1257874065-28, seq=112, quorate=1 Nov 11 01:27:45 psql01 pengine: [1755]: info: determine_online_status: Node psql01 is online Nov 11 01:27:45 psql01 attrd: [1754]: info: attrd_perform_update: Sent update 17: last-failure-failover-psql=1257874065 Nov 11 01:27:45 psql01 crmd: [1756]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=1, tag=transient_attributes, id=psql01, magic=NA, cib=0.782.18) : Transient attribute: update Nov 11 01:27:45 psql01 pengine: [1755]: WARN: unpack_rsc_op: Processing failed op failover-psql_monitor_30000 on psql01: not running (7) Nov 11 01:27:45 psql01 crmd: [1756]: info: do_pe_invoke: Query 45: Requesting the current CIB: S_POLICY_ENGINE Nov 11 01:27:45 psql01 pengine: [1755]: notice: clone_print: Clone Set: fencing Nov 11 01:27:45 psql01 crmd: [1756]: info: do_pe_invoke_callback: Invoking the PE: ref=pe_calc-dc-1257874065-29, seq=112, quorate=1 Nov 11 01:27:45 psql01 pengine: [1755]: notice: short_print: Started: [ psql01 psql02 ] Nov 11 01:27:45 psql01 pengine: [1755]: notice: native_print: failover-psql#011(lsb:postgresql-8.3):#011Started psql01 FAILED Nov 11 01:27:45 psql01 pengine: [1755]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started psql01 Nov 11 01:27:45 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (30s) for failover-psql on psql01 Nov 11 01:27:45 psql01 pengine: [1755]: notice: LogActions: Leave resource st-ssh:0#011(Started psql01) Nov 11 01:27:45 psql01 pengine: [1755]: notice: LogActions: Leave resource st-ssh:1#011(Started psql02) Nov 11 01:27:45 psql01 pengine: [1755]: notice: LogActions: Recover resource failover-psql#011(Started psql01) Nov 11 01:27:45 psql01 pengine: [1755]: notice: LogActions: Leave resource failover-ip#011(Started psql01) Nov 11 01:27:45 psql01 crmd: [1756]: info: handle_response: pe_calc calculation pe_calc-dc-1257874065-27 is obsolete Nov 11 01:27:45 psql01 pengine: [1755]: info: process_pe_message: Transition 4: PEngine Input stored in: /var/lib/pengine/pe-input-56.bz2 Nov 11 01:27:45 psql01 pengine: [1755]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 11 01:27:45 psql01 pengine: [1755]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0 Nov 11 01:27:45 psql01 pengine: [1755]: info: determine_online_status: Node psql02 is online Nov 11 01:27:45 psql01 pengine: [1755]: info: determine_online_status: Node psql01 is online Nov 11 01:27:45 psql01 pengine: [1755]: WARN: unpack_rsc_op: Processing failed op failover-psql_monitor_30000 on psql01: not running (7) Nov 11 01:27:45 psql01 pengine: [1755]: notice: clone_print: Clone Set: fencing Nov 11 01:27:45 psql01 pengine: [1755]: notice: short_print: Started: [ psql01 psql02 ] Nov 11 01:27:45 psql01 pengine: [1755]: notice: native_print: failover-psql#011(lsb:postgresql-8.3):#011Started psql01 FAILED Nov 11 01:27:45 psql01 pengine: [1755]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started psql01 Nov 11 01:27:45 psql01 pengine: [1755]: info: get_failcount: failover-psql has failed 1 times on psql01 Nov 11 01:27:45 psql01 pengine: [1755]: WARN: common_apply_stickiness: Forcing failover-psql away from psql01 after 1 failures (max=1) Nov 11 01:27:45 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (30s) for failover-psql on psql02 Nov 11 01:27:45 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (5s) for failover-ip on psql02 Nov 11 01:27:45 psql01 pengine: [1755]: notice: LogActions: Leave resource st-ssh:0#011(Started psql01) Nov 11 01:27:45 psql01 pengine: [1755]: notice: LogActions: Leave resource st-ssh:1#011(Started psql02) Nov 11 01:27:45 psql01 pengine: [1755]: notice: LogActions: Move resource failover-psql#011(Started psql01 -> psql02) Nov 11 01:27:45 psql01 pengine: [1755]: notice: LogActions: Move resource failover-ip#011(Started psql01 -> psql02) Nov 11 01:27:45 psql01 crmd: [1756]: info: handle_response: pe_calc calculation pe_calc-dc-1257874065-28 is obsolete Nov 11 01:27:45 psql01 pengine: [1755]: info: process_pe_message: Transition 5: PEngine Input stored in: /var/lib/pengine/pe-input-57.bz2 Nov 11 01:27:45 psql01 pengine: [1755]: notice: unpack_config: On loss of CCM Quorum: Ignore Nov 11 01:27:45 psql01 pengine: [1755]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0 Nov 11 01:27:45 psql01 pengine: [1755]: info: determine_online_status: Node psql02 is online Nov 11 01:27:45 psql01 pengine: [1755]: info: determine_online_status: Node psql01 is online Nov 11 01:27:45 psql01 pengine: [1755]: WARN: unpack_rsc_op: Processing failed op failover-psql_monitor_30000 on psql01: not running (7) Nov 11 01:27:45 psql01 pengine: [1755]: notice: clone_print: Clone Set: fencing Nov 11 01:27:45 psql01 pengine: [1755]: notice: short_print: Started: [ psql01 psql02 ] Nov 11 01:27:45 psql01 pengine: [1755]: notice: native_print: failover-psql#011(lsb:postgresql-8.3):#011Started psql01 FAILED Nov 11 01:27:45 psql01 pengine: [1755]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started psql01 Nov 11 01:27:45 psql01 pengine: [1755]: info: get_failcount: failover-psql has failed 1 times on psql01 Nov 11 01:27:45 psql01 pengine: [1755]: WARN: common_apply_stickiness: Forcing failover-psql away from psql01 after 1 failures (max=1) Nov 11 01:27:45 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (30s) for failover-psql on psql02 Nov 11 01:27:45 psql01 pengine: [1755]: notice: RecurringOp: Start recurring monitor (5s) for failover-ip on psql02 Nov 11 01:27:45 psql01 pengine: [1755]: notice: LogActions: Leave resource st-ssh:0#011(Started psql01) Nov 11 01:27:45 psql01 pengine: [1755]: notice: LogActions: Leave resource st-ssh:1#011(Started psql02) Nov 11 01:27:45 psql01 pengine: [1755]: notice: LogActions: Move resource failover-psql#011(Started psql01 -> psql02) Nov 11 01:27:45 psql01 pengine: [1755]: notice: LogActions: Move resource failover-ip#011(Started psql01 -> psql02) Nov 11 01:27:45 psql01 crmd: [1756]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ] Nov 11 01:27:45 psql01 crmd: [1756]: info: unpack_graph: Unpacked transition 6: 7 actions in 7 synapses Nov 11 01:27:45 psql01 crmd: [1756]: info: do_te_invoke: Processing graph 6 (ref=pe_calc-dc-1257874065-29) derived from /var/lib/pengine/pe-input-58.bz2 Nov 11 01:27:45 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 3: stop failover-psql_stop_0 on psql01 (local) Nov 11 01:27:45 psql01 crmd: [1756]: info: do_lrm_rsc_op: Performing key=3:6:0:b3f6f6c3-0d0f-42a7-b357-36c601930ddf op=failover-psql_stop_0 ) Nov 11 01:27:45 psql01 pengine: [1755]: info: process_pe_message: Transition 6: PEngine Input stored in: /var/lib/pengine/pe-input-58.bz2 Nov 11 01:27:45 psql01 lrmd: [1753]: info: rsc:failover-psql:10: stop Nov 11 01:27:45 psql01 lrmd: [2611]: WARN: For LSB init script, no additional parameters are needed. Nov 11 01:27:45 psql01 crmd: [1756]: info: process_lrm_event: LRM operation failover-psql_monitor_30000 (call=9, status=1, cib-update=0, confirmed=true) Cancelled Nov 11 01:27:45 psql01 lrmd: [1753]: info: RA output: (failover-psql:stop:stdout) Stopping PostgreSQL 8.3 database server: Nov 11 01:27:45 psql01 lrmd: [1753]: info: RA output: (failover-psql:stop:stdout) main Nov 11 01:27:45 psql01 lrmd: [1753]: info: RA output: (failover-psql:stop:stdout) . Nov 11 01:27:45 psql01 crmd: [1756]: info: process_lrm_event: LRM operation failover-psql_stop_0 (call=10, rc=0, cib-update=46, confirmed=true) ok Nov 11 01:27:45 psql01 crmd: [1756]: info: match_graph_event: Action failover-psql_stop_0 (3) confirmed on psql01 (rc=0) Nov 11 01:27:45 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 18: stop failover-ip_stop_0 on psql01 (local) Nov 11 01:27:45 psql01 crmd: [1756]: info: do_lrm_rsc_op: Performing key=18:6:0:b3f6f6c3-0d0f-42a7-b357-36c601930ddf op=failover-ip_stop_0 ) Nov 11 01:27:45 psql01 lrmd: [1753]: info: rsc:failover-ip:11: stop Nov 11 01:27:45 psql01 crmd: [1756]: info: process_lrm_event: LRM operation failover-ip_monitor_5000 (call=8, status=1, cib-update=0, confirmed=true) Cancelled Nov 11 01:27:45 psql01 lrmd: [1753]: info: RA output: (failover-ip:stop:stdout) In IP Stop Nov 11 01:27:45 psql01 lrmd: [1753]: info: RA output: (failover-ip:stop:stderr) SIOCDELRT: No such process Nov 11 01:27:45 psql01 IPaddr[2618]: INFO: ifconfig eth0:0 down Nov 11 01:27:45 psql01 lrmd: [1753]: info: RA output: (failover-ip:stop:stderr) 2009/11/11_01:27:45 INFO: ifconfig eth0:0 down Nov 11 01:27:45 psql01 crmd: [1756]: info: process_lrm_event: LRM operation failover-ip_stop_0 (call=11, rc=0, cib-update=47, confirmed=true) ok Nov 11 01:27:45 psql01 crmd: [1756]: info: match_graph_event: Action failover-ip_stop_0 (18) confirmed on psql01 (rc=0) Nov 11 01:27:45 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 19: start failover-ip_start_0 on psql02 Nov 11 01:27:45 psql01 crmd: [1756]: info: te_pseudo_action: Pseudo action 4 fired and confirmed Nov 11 01:27:46 psql01 crmd: [1756]: info: match_graph_event: Action failover-ip_start_0 (19) confirmed on psql02 (rc=0) Nov 11 01:27:46 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 16: start failover-psql_start_0 on psql02 Nov 11 01:27:46 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 20: monitor failover-ip_monitor_5000 on psql02 Nov 11 01:27:46 psql01 crmd: [1756]: info: match_graph_event: Action failover-ip_monitor_5000 (20) confirmed on psql02 (rc=0) Nov 11 01:27:53 psql01 crmd: [1756]: info: match_graph_event: Action failover-psql_start_0 (16) confirmed on psql02 (rc=0) Nov 11 01:27:53 psql01 crmd: [1756]: info: te_rsc_command: Initiating action 17: monitor failover-psql_monitor_30000 on psql02 Nov 11 01:27:54 psql01 crmd: [1756]: info: match_graph_event: Action failover-psql_monitor_30000 (17) confirmed on psql02 (rc=0) Nov 11 01:27:54 psql01 crmd: [1756]: info: run_graph: ==================================================== Nov 11 01:27:54 psql01 crmd: [1756]: notice: run_graph: Transition 6 (Complete=7, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-58.bz2): Complete Nov 11 01:27:54 psql01 crmd: [1756]: info: te_graph_trigger: Transition 6 is now complete Nov 11 01:27:54 psql01 crmd: [1756]: info: notify_crmd: Transition 6 status: done - Nov 11 01:27:54 psql01 crmd: [1756]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_FSA_INTERNAL origin=notify_crmd ] Nov 11 01:27:54 psql01 crmd: [1756]: info: do_state_transition: Starting PEngine Recheck Timer Nov 11 01:34:30 psql01 cib: [1752]: info: cib_stats: Processed 77 operations (9350.00us average, 0% utilization) in the last 10min