Fuuuuuu ... Thank God for Fox self-hosting.


User avatar
sleeper_service
Bear Rating Overlord
Bear Rating Overlord
Posts: 884
Joined: 30 Mar 2013, 23:50
Location: Dallas, Texas

Re: Fuuuuuu ... Thank God for Fox self-hosting.

Postby sleeper_service » 02 Feb 2017, 22:55

fox, god is your sysadmin now?

tsimmons
Bear Rating Trainee
Bear Rating Trainee
Posts: 17
Joined: 06 Nov 2013, 20:46

Re: Fuuuuuu ... Thank God for Fox self-hosting.

Postby tsimmons » 02 Feb 2017, 23:16

God is everyone's admin. ;-)

User avatar
fox
^ me reading your posts ^
Posts: 6318
Joined: 27 Aug 2005, 22:53
Location: Saint-Petersburg, Russia
Contact:

Re: Fuuuuuu ... Thank God for Fox self-hosting.

Postby fox » 02 Feb 2017, 23:26

yeah what a ride for that poor guy lol

tsimmons
Bear Rating Trainee
Bear Rating Trainee
Posts: 17
Joined: 06 Nov 2013, 20:46

Re: Fuuuuuu ... Thank God for Fox self-hosting.

Postby tsimmons » 02 Feb 2017, 23:33

At 2017/01/31 11pm-ish UTC, team-member-1 thinks that perhaps pg_basebackup is refusing to work due to the PostgreSQL data directory being present (despite being empty), decides to remove the directory. After a second or two he notices he ran it on db1.cluster.gitlab.com, instead of db2.cluster.gitlab.com.


Been there, done that, only not at that scale.

JustAMacUser
Bear Rating Overlord
Bear Rating Overlord
Posts: 373
Joined: 20 Aug 2013, 23:13

Re: Fuuuuuu ... Thank God for Fox self-hosting.

Postby JustAMacUser » 02 Feb 2017, 23:34

On a positive note, it's nice that he manually took a snapshot so only six hours of data was lost.

User avatar
sleeper_service
Bear Rating Overlord
Bear Rating Overlord
Posts: 884
Joined: 30 Mar 2013, 23:50
Location: Dallas, Texas

Re: Fuuuuuu ... Thank God for Fox self-hosting.

Postby sleeper_service » 02 Feb 2017, 23:38

tsimmons wrote:God is everyone's admin. ;-)

which god?

User avatar
fox
^ me reading your posts ^
Posts: 6318
Joined: 27 Aug 2005, 22:53
Location: Saint-Petersburg, Russia
Contact:

Re: Fuuuuuu ... Thank God for Fox self-hosting.

Postby fox » 02 Feb 2017, 23:41

tbh i would assume a company like that would at least use ansible or puppet or whatever instead of running shit on random servers via login shell


Return to “Everything else”

Who is online

Users browsing this forum: No registered users and 4 guests