Slrpnk.net outage
-
people hate the big cloud solutions, but this is the kind of thing their HA infrastructure prevents against... hardware failures
i dont enjoy using (or paying for) aws, but i will never have a firewall or disk failure.
Their HA infrastructure is all built on open source projects. The thing they have that we don't is teams of SREs on-call 24/7.
-
Yeah, but at least I have not disappeared yet
I see you understand the allusion.
-
Alt account of poVoq@slrpnk.net here.
Our instance is currently down and I can't get remote access to the servers. It appears that there might have been a hardware failure of the main firewall, which is the one thing I can't work around remotely.
I am still trying a few things, but I am not very optimistic that I can get access.
The really unfortunate part is that just now I am on one of my rare work deployments abroad, so I also can't access it physically during the next few weeks and my usual back up that could restart it is not available either.
As something like that never happened in 3 years operating the servers, I thought I can risk it, but murphy's law seems inescapable
I will try to keep you posted here on any updates, but probably there will not be much I can do for a while. Really bad timing
Edit: we might use this "opportunity" to migrate the instance to Piefed, which has been an idea for quite some time now. I will keep you posted on that.
It looks like there is no enough solar power for solarpunk!
no need to show me where doors are, I will find them by myselfanyway, good luck with that!
-
Alt account of poVoq@slrpnk.net here.
Our instance is currently down and I can't get remote access to the servers. It appears that there might have been a hardware failure of the main firewall, which is the one thing I can't work around remotely.
I am still trying a few things, but I am not very optimistic that I can get access.
The really unfortunate part is that just now I am on one of my rare work deployments abroad, so I also can't access it physically during the next few weeks and my usual back up that could restart it is not available either.
As something like that never happened in 3 years operating the servers, I thought I can risk it, but murphy's law seems inescapable
I will try to keep you posted here on any updates, but probably there will not be much I can do for a while. Really bad timing
Edit: we might use this "opportunity" to migrate the instance to Piefed, which has been an idea for quite some time now. I will keep you posted on that.
Thanks for the heads up, try not to stress too much.
-
Alt account of poVoq@slrpnk.net here.
Our instance is currently down and I can't get remote access to the servers. It appears that there might have been a hardware failure of the main firewall, which is the one thing I can't work around remotely.
I am still trying a few things, but I am not very optimistic that I can get access.
The really unfortunate part is that just now I am on one of my rare work deployments abroad, so I also can't access it physically during the next few weeks and my usual back up that could restart it is not available either.
As something like that never happened in 3 years operating the servers, I thought I can risk it, but murphy's law seems inescapable
I will try to keep you posted here on any updates, but probably there will not be much I can do for a while. Really bad timing
Edit: we might use this "opportunity" to migrate the instance to Piefed, which has been an idea for quite some time now. I will keep you posted on that.
Alt of ProdigalFrog@slrpnk.net chiming in, thanks for giving us the sitrep, poVoq!
This is an unusually unlucky set of circumstances, but for the Solarpunks who find their way here, let's try to make the best of it. If you don't already have an alternative account somewhere, you may want to create one to use until we're back up and running. lemmy.dbzer0.com, sopuli.xyz, or lemmy.cafe are some solid choices to consider. After that, you may want to favorite poVoq's post here so you can check back on any news.
Even without our home base, we can still share the solarpunky stuff we find and create around the threadiverse (though as Tofu mentioned, maybe this could be a time to take a breather to be refreshed when we come back
).Besides, if the past is any indication, time will fly by and we'll be back before you know it!
-
Alt account of poVoq@slrpnk.net here.
Our instance is currently down and I can't get remote access to the servers. It appears that there might have been a hardware failure of the main firewall, which is the one thing I can't work around remotely.
I am still trying a few things, but I am not very optimistic that I can get access.
The really unfortunate part is that just now I am on one of my rare work deployments abroad, so I also can't access it physically during the next few weeks and my usual back up that could restart it is not available either.
As something like that never happened in 3 years operating the servers, I thought I can risk it, but murphy's law seems inescapable
I will try to keep you posted here on any updates, but probably there will not be much I can do for a while. Really bad timing
Edit: we might use this "opportunity" to migrate the instance to Piefed, which has been an idea for quite some time now. I will keep you posted on that.
You guys have always been excellent. As others have stated, no need to worry.
I'll be giving piefed some love in the meantime
-
I see you understand the allusion.
I did not, can you give me a hint ?
-
Alt of ProdigalFrog@slrpnk.net chiming in, thanks for giving us the sitrep, poVoq!
This is an unusually unlucky set of circumstances, but for the Solarpunks who find their way here, let's try to make the best of it. If you don't already have an alternative account somewhere, you may want to create one to use until we're back up and running. lemmy.dbzer0.com, sopuli.xyz, or lemmy.cafe are some solid choices to consider. After that, you may want to favorite poVoq's post here so you can check back on any news.
Even without our home base, we can still share the solarpunky stuff we find and create around the threadiverse (though as Tofu mentioned, maybe this could be a time to take a breather to be refreshed when we come back
).Besides, if the past is any indication, time will fly by and we'll be back before you know it!
Well, on the plus side lots of lessons learned and I think I might move at least the xmpp server to an external vps to have a backup communication channel.
-
I did not, can you give me a hint ?
The feddit.de admin disappeared on a work trip to Japan. At least that is the official story.
-
One issue in three years is poor management now? Wat
I signed up with them yesterday and then they go down for I don’t know how long. This is my only experience with them.
-
Out of 3 years of reliable service, this is the one time the server has been down for any length of time, and only due to the admin not being able to be physically present for a wildly unlikely and unexpected problem.
I signed up with them yesterday and then they go down for I don’t know how long. This is my only experience with them.
-
I signed up with them yesterday and then they go down for I don’t know how long. This is my only experience with them.
Ok, and?
That doesn't change the fact this is a one off issue and theyve never had that issue in three years. -
Ok, and?
That doesn't change the fact this is a one off issue and theyve never had that issue in three years.This is a very big issue for a server no mater when it happens. A sever you can’t reset and you go on a trip ridiculous.
-
I signed up with them yesterday and then they go down for I don’t know how long. This is my only experience with them.
I know, I'm the one who approved your application.
You happened to sign up right before we've had our first particularly bad issue in 3 years. Unlucky, yes, but it's a bit out of order (IMO) to say we're a poorly managed instance based on that, especially seeing as you lost nothing besides the time it took to write your application.
![😕](https://forum.wedistribute.org/assets/plugins/nodebb-plugin-emoji/emoji/android/1f615.png?v=8eaae6ed46b ":\")
-
The feddit.de admin disappeared on a work trip to Japan. At least that is the official story.
Evil tongues claim he is in North Korea.
-
This is a very big issue for a server no mater when it happens. A sever you can’t reset and you go on a trip ridiculous.
You are acting like this is a life or death situation. I think you may need to take a break from the internet.
-
I know, I'm the one who approved your application.
You happened to sign up right before we've had our first particularly bad issue in 3 years. Unlucky, yes, but it's a bit out of order (IMO) to say we're a poorly managed instance based on that, especially seeing as you lost nothing besides the time it took to write your application.
My loss of time is small true. I will just move on. But keep in mind new users may not be as knowledgeable as myself.
-
This is a very big issue for a server no mater when it happens. A sever you can’t reset and you go on a trip ridiculous.
It usually can be reset, it's entirely unexpected that a component that enables that functionality would randomly break. You're essentially implying that any admin who self hosts cannot ever leave their house for any length of time without being irresponsible because they cannot ensure with 100% certainly that a computer component won't fail while their gone, or a lightning storm won't fry something, or a flood won't harm the servers.
Like, dude, c'mon. We're volunteers, and poVoq is running this stuff for free. We're not an enterprise business with multiple staff on hand to swap out failed components 24/7 so that our 'customers' don't lose millions of dollars.
If anything, this only proves the strength of decentralized media, as we're able to swap to a functioning node and continue on our merry way while the other is being repaired. Like what an incredible and resilient system considering none of this is making anyone any money.
-
Alt account of poVoq@slrpnk.net here.
Our instance is currently down and I can't get remote access to the servers. It appears that there might have been a hardware failure of the main firewall, which is the one thing I can't work around remotely.
I am still trying a few things, but I am not very optimistic that I can get access.
The really unfortunate part is that just now I am on one of my rare work deployments abroad, so I also can't access it physically during the next few weeks and my usual back up that could restart it is not available either.
As something like that never happened in 3 years operating the servers, I thought I can risk it, but murphy's law seems inescapable
I will try to keep you posted here on any updates, but probably there will not be much I can do for a while. Really bad timing
Edit: we might use this "opportunity" to migrate the instance to Piefed, which has been an idea for quite some time now. I will keep you posted on that.
Shit happens. Thanks for the update
-
Alt account of poVoq@slrpnk.net here.
Our instance is currently down and I can't get remote access to the servers. It appears that there might have been a hardware failure of the main firewall, which is the one thing I can't work around remotely.
I am still trying a few things, but I am not very optimistic that I can get access.
The really unfortunate part is that just now I am on one of my rare work deployments abroad, so I also can't access it physically during the next few weeks and my usual back up that could restart it is not available either.
As something like that never happened in 3 years operating the servers, I thought I can risk it, but murphy's law seems inescapable
I will try to keep you posted here on any updates, but probably there will not be much I can do for a while. Really bad timing
Edit: we might use this "opportunity" to migrate the instance to Piefed, which has been an idea for quite some time now. I will keep you posted on that.
Sending positive vibes, and passing offer of technical assistance once you get access again.
Hopefully it's an easy fix once you get into things again.
