##### Log from Postgres slave when init 0 was done on Master 2015-03-17 07:34:25 SAST LOG: replication terminated by primary server 2015-03-17 07:34:25 SAST DETAIL: End of WAL reached on timeline 29 at 8/C2000090. 2015-03-17 07:34:25 SAST FATAL: could not send end-of-streaming message to primary: no COPY in progress cp: cannot stat `/pgtablespace/archive/0000001E.history': No such file or directory cp: cannot stat `/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:34:25 SAST LOG: record with zero length at 8/C2000090 2015-03-17 07:34:25 SAST FATAL: could not connect to the primary server: FATAL: the database system is shutting down cp: cannot stat `/pgtablespace/archive/0000001E.history': No such file or directory cp: cannot stat `/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:34:28 SAST LOG: received promote request 2015-03-17 07:34:28 SAST LOG: redo done at 8/C2000028 2015-03-17 07:34:28 SAST LOG: last completed transaction was at log time 2015-03-17 07:34:00.289206+02 cp: cannot stat `/pgtablespace/archive/0000001D00000008000000C2': No such file or directory cp: cannot stat `/pgtablespace/archive/0000001E.history': No such file or directory 2015-03-17 07:34:28 SAST LOG: selected new timeline ID: 30 cp: cannot stat `/pgtablespace/archive/0000001D.history': No such file or directory 2015-03-17 07:34:28 SAST LOG: archive recovery complete 2015-03-17 07:34:28 SAST LOG: database system is ready to accept connections 2015-03-17 07:34:28 SAST LOG: autovacuum launcher started cp: cannot create regular file `172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:34:28 SAST LOG: archive command failed with exit code 1 2015-03-17 07:34:28 SAST DETAIL: The failed archive command was: cp pg_xlog/0000001D00000008000000C2 172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2 cp: cannot create regular file `172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:34:29 SAST LOG: archive command failed with exit code 1 2015-03-17 07:34:29 SAST DETAIL: The failed archive command was: cp pg_xlog/0000001D00000008000000C2 172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2 cp: cannot create regular file `172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:34:30 SAST LOG: archive command failed with exit code 1 2015-03-17 07:34:30 SAST DETAIL: The failed archive command was: cp pg_xlog/0000001D00000008000000C2 172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2 2015-03-17 07:34:30 SAST WARNING: archiving transaction log file "0000001D00000008000000C2" failed too many times, will try again later ##### Once the original Master was restarted and Corosync restarted, this below is what happened in the Slave log cl2_lb1:/opt/app/pgdata/9.3/pg_log # tail -f postgresql-2015-03-17_073111.log cp: cannot create regular file `172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:36:32 SAST LOG: archive command failed with exit code 1 2015-03-17 07:36:32 SAST DETAIL: The failed archive command was: cp pg_xlog/0000001D00000008000000C2 172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2 cp: cannot create regular file `172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:36:34 SAST LOG: archive command failed with exit code 1 2015-03-17 07:36:34 SAST DETAIL: The failed archive command was: cp pg_xlog/0000001D00000008000000C2 172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2 cp: cannot create regular file `172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:36:35 SAST LOG: archive command failed with exit code 1 2015-03-17 07:36:35 SAST DETAIL: The failed archive command was: cp pg_xlog/0000001D00000008000000C2 172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2 2015-03-17 07:36:35 SAST WARNING: archiving transaction log file "0000001D00000008000000C2" failed too many times, will try again later 2015-03-17 07:37:22 SAST LOG: received fast shutdown request 2015-03-17 07:37:22 SAST LOG: aborting any active transactions 2015-03-17 07:37:22 SAST FATAL: terminating connection due to administrator command 2015-03-17 07:37:22 SAST LOG: autovacuum launcher shutting down 2015-03-17 07:37:22 SAST LOG: shutting down cp: cannot create regular file `172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:37:22 SAST LOG: archive command failed with exit code 1 2015-03-17 07:37:22 SAST DETAIL: The failed archive command was: cp pg_xlog/0000001D00000008000000C2 172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2 2015-03-17 07:37:22 SAST LOG: database system is shut down cp: cannot create regular file `172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:37:22 SAST LOG: archive command failed with exit code 1 2015-03-17 07:37:22 SAST DETAIL: The failed archive command was: cp pg_xlog/0000001D00000008000000C2 172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2 cp: cannot create regular file `172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:37:23 SAST LOG: archive command failed with exit code 1 2015-03-17 07:37:23 SAST DETAIL: The failed archive command was: cp pg_xlog/0000001D00000008000000C2 172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2 2015-03-17 07:37:23 SAST WARNING: archiving transaction log file "0000001D00000008000000C2" failed too many times, will try again later cp: cannot create regular file `172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:37:23 SAST LOG: archive command failed with exit code 1 2015-03-17 07:37:23 SAST DETAIL: The failed archive command was: cp pg_xlog/0000001D00000008000000C2 172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2 cp: cannot create regular file `172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:37:24 SAST LOG: archive command failed with exit code 1 2015-03-17 07:37:24 SAST DETAIL: The failed archive command was: cp pg_xlog/0000001D00000008000000C2 172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2 cp: cannot create regular file `172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2': No such file or directory 2015-03-17 07:37:25 SAST LOG: archive command failed with exit code 1 2015-03-17 07:37:25 SAST DETAIL: The failed archive command was: cp pg_xlog/0000001D00000008000000C2 172.16.0.5:/pgtablespace/archive/0000001D00000008000000C2 2015-03-17 07:37:25 SAST WARNING: archiving transaction log file "0000001D00000008000000C2" failed too many times, will try again later