PDA

View Full Version : Here's what happened


Caniac
03-17-2003, 01:40 PM
Here's what our host had happen:

On Wednesday afternoon sometime, my Internet provider cut off all access to any and all machines in the datacenter, which is located in Colorado. I found out about this late last night, around 11 pm or so. Other customers of this same provider are in the same boat. I have known for some time that this firm was in financial trouble and have been making migration plans for the past three months or so. (Some of you are aware of this, as you've asked about it before this week.) However, it would appear time wasn't on our side with this one. It almost seems as if utilities were cut out to this place, or some sort of immediate business disruption took place. I really don't know. I have been trying to contact the people in the datacenter all day, but I am limited in what I can do from a cell phone driving up I-95 for 8 hours.

We had backup procedures in place that run both nightly (as a differential) and weekly (as a full backup). So there ARE backups of your individual sites, databases and all, but they are on a separate physical disk inside another machine at the datacenter, and of course I cannot get to that. I do have some copies of databases here on my local machines from when we did another server migration, but this was back in September, and that would be the latest copy I have. I certainly do not have copies of everybody's data. Unfortunately at this time I cannot guarantee that your data is preserved. I am doing my damndest to try and get two hours with this machine to get all the backups off - I can manually restore them all very easily if I can just get the backup - but this may be out of my hands. I really don't know and time will tell. I sincerely apologize about this.

Right now, I do have another server up and running in another, separate, financially secure datacenter. This has actually been running since mid-February and it's ready for accounts. The problem is that I have to have official nameservers registered with InterNIC in order to instruct people to move their nameservers to this domain; otherwise, the process will error out. As well, I have to change the IP addresses associated with my nameservers now (ns/ns2.enablehosting.com) to point to the new machine. Unfortunately this takes 24-48 hours to propagate around the Internet, and there's absolutely nothing I can do about that. The process has been started - I was able to do that on my cell phone today - but again, it takes time and it's completely out of my hands.

So then we had to wait for the new nameservers to propogate. That took till early this morning.

And also, as you read, the nightly and weekly data and database backups are gone.

I will now bring those down locally so this doesn't happen again.

So that's what's happened, in a nutshell. There were other details but I won't bore you with those.

We were given a year's extension on our account and a solemn vow it will never happen again, so that's good.

Lucky to be back,
Caniac

Caniac
03-17-2003, 01:40 PM
Here's what our host had happen:

On Wednesday afternoon sometime, my Internet provider cut off all access to any and all machines in the datacenter, which is located in Colorado. I found out about this late last night, around 11 pm or so. Other customers of this same provider are in the same boat. I have known for some time that this firm was in financial trouble and have been making migration plans for the past three months or so. (Some of you are aware of this, as you've asked about it before this week.) However, it would appear time wasn't on our side with this one. It almost seems as if utilities were cut out to this place, or some sort of immediate business disruption took place. I really don't know. I have been trying to contact the people in the datacenter all day, but I am limited in what I can do from a cell phone driving up I-95 for 8 hours.

We had backup procedures in place that run both nightly (as a differential) and weekly (as a full backup). So there ARE backups of your individual sites, databases and all, but they are on a separate physical disk inside another machine at the datacenter, and of course I cannot get to that. I do have some copies of databases here on my local machines from when we did another server migration, but this was back in September, and that would be the latest copy I have. I certainly do not have copies of everybody's data. Unfortunately at this time I cannot guarantee that your data is preserved. I am doing my damndest to try and get two hours with this machine to get all the backups off - I can manually restore them all very easily if I can just get the backup - but this may be out of my hands. I really don't know and time will tell. I sincerely apologize about this.

Right now, I do have another server up and running in another, separate, financially secure datacenter. This has actually been running since mid-February and it's ready for accounts. The problem is that I have to have official nameservers registered with InterNIC in order to instruct people to move their nameservers to this domain; otherwise, the process will error out. As well, I have to change the IP addresses associated with my nameservers now (ns/ns2.enablehosting.com) to point to the new machine. Unfortunately this takes 24-48 hours to propagate around the Internet, and there's absolutely nothing I can do about that. The process has been started - I was able to do that on my cell phone today - but again, it takes time and it's completely out of my hands.

So then we had to wait for the new nameservers to propogate. That took till early this morning.

And also, as you read, the nightly and weekly data and database backups are gone.

I will now bring those down locally so this doesn't happen again.

So that's what's happened, in a nutshell. There were other details but I won't bore you with those.

We were given a year's extension on our account and a solemn vow it will never happen again, so that's good.

Lucky to be back,
Caniac

Caniac
03-17-2003, 01:40 PM
Here's what our host had happen:

On Wednesday afternoon sometime, my Internet provider cut off all access to any and all machines in the datacenter, which is located in Colorado. I found out about this late last night, around 11 pm or so. Other customers of this same provider are in the same boat. I have known for some time that this firm was in financial trouble and have been making migration plans for the past three months or so. (Some of you are aware of this, as you've asked about it before this week.) However, it would appear time wasn't on our side with this one. It almost seems as if utilities were cut out to this place, or some sort of immediate business disruption took place. I really don't know. I have been trying to contact the people in the datacenter all day, but I am limited in what I can do from a cell phone driving up I-95 for 8 hours.

We had backup procedures in place that run both nightly (as a differential) and weekly (as a full backup). So there ARE backups of your individual sites, databases and all, but they are on a separate physical disk inside another machine at the datacenter, and of course I cannot get to that. I do have some copies of databases here on my local machines from when we did another server migration, but this was back in September, and that would be the latest copy I have. I certainly do not have copies of everybody's data. Unfortunately at this time I cannot guarantee that your data is preserved. I am doing my damndest to try and get two hours with this machine to get all the backups off - I can manually restore them all very easily if I can just get the backup - but this may be out of my hands. I really don't know and time will tell. I sincerely apologize about this.

Right now, I do have another server up and running in another, separate, financially secure datacenter. This has actually been running since mid-February and it's ready for accounts. The problem is that I have to have official nameservers registered with InterNIC in order to instruct people to move their nameservers to this domain; otherwise, the process will error out. As well, I have to change the IP addresses associated with my nameservers now (ns/ns2.enablehosting.com) to point to the new machine. Unfortunately this takes 24-48 hours to propagate around the Internet, and there's absolutely nothing I can do about that. The process has been started - I was able to do that on my cell phone today - but again, it takes time and it's completely out of my hands.

So then we had to wait for the new nameservers to propogate. That took till early this morning.

And also, as you read, the nightly and weekly data and database backups are gone.

I will now bring those down locally so this doesn't happen again.

So that's what's happened, in a nutshell. There were other details but I won't bore you with those.

We were given a year's extension on our account and a solemn vow it will never happen again, so that's good.

Lucky to be back,
Caniac

mikus
03-17-2003, 03:18 PM
and you didn't made backups over the admin panel? :?:

mikus
03-17-2003, 03:18 PM
and you didn't made backups over the admin panel? :?:

mikus
03-17-2003, 03:18 PM
and you didn't made backups over the admin panel? :?:

Caniac
03-17-2003, 03:34 PM
I hadn't recently because I had access to the automatic backups, so therefore I thought there was no need.

But as I said, I will be bringing down backups to my local machine to avoid such an event in the future.

Caniac
03-17-2003, 03:34 PM
I hadn't recently because I had access to the automatic backups, so therefore I thought there was no need.

But as I said, I will be bringing down backups to my local machine to avoid such an event in the future.

Caniac
03-17-2003, 03:34 PM
I hadn't recently because I had access to the automatic backups, so therefore I thought there was no need.

But as I said, I will be bringing down backups to my local machine to avoid such an event in the future.

mikus
03-17-2003, 03:35 PM
I hadn't recently because I had access to the automatic backups, so therefore I thought there was no need.

But as I said, I will be bringing down backups to my local machine to avoid such an event in the future.
you should always do that...i mean, how big was your backup file before? 5mb? with cable..no prob :D

mikus
03-17-2003, 03:35 PM
I hadn't recently because I had access to the automatic backups, so therefore I thought there was no need.

But as I said, I will be bringing down backups to my local machine to avoid such an event in the future.
you should always do that...i mean, how big was your backup file before? 5mb? with cable..no prob :D

mikus
03-17-2003, 03:35 PM
I hadn't recently because I had access to the automatic backups, so therefore I thought there was no need.

But as I said, I will be bringing down backups to my local machine to avoid such an event in the future.
you should always do that...i mean, how big was your backup file before? 5mb? with cable..no prob :D

Goldwolf
03-17-2003, 03:36 PM
hindsight is always 20/20.....no need to lecture caniac

Goldwolf
03-17-2003, 03:36 PM
hindsight is always 20/20.....no need to lecture caniac

Goldwolf
03-17-2003, 03:36 PM
hindsight is always 20/20.....no need to lecture caniac

mikus
03-17-2003, 03:38 PM
hindsight is always 20/20.....no need to lecture caniac
??

mikus
03-17-2003, 03:38 PM
hindsight is always 20/20.....no need to lecture caniac
??

mikus
03-17-2003, 03:38 PM
hindsight is always 20/20.....no need to lecture caniac
??

Caniac
03-17-2003, 03:39 PM
mikus, I'm having a pretty rough day, rough last week, rough last month and rough last few months. I'm trying to take that last comment as "constructive criticism" but I'm having a hard time seeing it as anything else than a "neener neener".

I don't need people taking that attitude at this point.

Caniac
03-17-2003, 03:39 PM
mikus, I'm having a pretty rough day, rough last week, rough last month and rough last few months. I'm trying to take that last comment as "constructive criticism" but I'm having a hard time seeing it as anything else than a "neener neener".

I don't need people taking that attitude at this point.

Caniac
03-17-2003, 03:39 PM
mikus, I'm having a pretty rough day, rough last week, rough last month and rough last few months. I'm trying to take that last comment as "constructive criticism" but I'm having a hard time seeing it as anything else than a "neener neener".

I don't need people taking that attitude at this point.

crazy4canes
03-17-2003, 03:39 PM
Tell the truth, Boss. The ladies only threads brought LGC crashing down, didn't they? :wink: :D

crazy4canes
03-17-2003, 03:39 PM
Tell the truth, Boss. The ladies only threads brought LGC crashing down, didn't they? :wink: :D

crazy4canes
03-17-2003, 03:39 PM
Tell the truth, Boss. The ladies only threads brought LGC crashing down, didn't they? :wink: :D

Caniac
03-17-2003, 03:39 PM
Hahahaha NO. :eek2: ;)

Caniac
03-17-2003, 03:39 PM
Hahahaha NO. :eek2: ;)

Caniac
03-17-2003, 03:39 PM
Hahahaha NO. :eek2: ;)

mikus
03-17-2003, 03:42 PM
mikus, I'm having a pretty rough day, rough last week, rough last month and rough last few months. I'm trying to take that last comment as "constructive criticism" but I'm having a hard time seeing it as anything else than a "neener neener".

I don't need people taking that attitude at this point.
hey sorry, just wanted to say a weekly backup or something wouldn't be a big problem would it?
didn't want to annoy you

mikus
03-17-2003, 03:42 PM
mikus, I'm having a pretty rough day, rough last week, rough last month and rough last few months. I'm trying to take that last comment as "constructive criticism" but I'm having a hard time seeing it as anything else than a "neener neener".

I don't need people taking that attitude at this point.
hey sorry, just wanted to say a weekly backup or something wouldn't be a big problem would it?
didn't want to annoy you

mikus
03-17-2003, 03:42 PM
mikus, I'm having a pretty rough day, rough last week, rough last month and rough last few months. I'm trying to take that last comment as "constructive criticism" but I'm having a hard time seeing it as anything else than a "neener neener".

I don't need people taking that attitude at this point.
hey sorry, just wanted to say a weekly backup or something wouldn't be a big problem would it?
didn't want to annoy you

Caniac
03-17-2003, 03:43 PM
No, it won't be. And as I said in the first post, I will be doing that from now on.

Sorry if I came off a little hostile, it's just one of those times right now.

Caniac
03-17-2003, 03:43 PM
No, it won't be. And as I said in the first post, I will be doing that from now on.

Sorry if I came off a little hostile, it's just one of those times right now.

Caniac
03-17-2003, 03:43 PM
No, it won't be. And as I said in the first post, I will be doing that from now on.

Sorry if I came off a little hostile, it's just one of those times right now.

StormShaman
03-17-2003, 04:42 PM
Boss, it's St. Patrick's Day.

Go have a Guinness and kick back for the evening. :) You deserve the proverbial break today. :)

StormShaman
03-17-2003, 04:42 PM
Boss, it's St. Patrick's Day.

Go have a Guinness and kick back for the evening. :) You deserve the proverbial break today. :)

StormShaman
03-17-2003, 04:42 PM
Boss, it's St. Patrick's Day.

Go have a Guinness and kick back for the evening. :) You deserve the proverbial break today. :)

moonstomper
03-17-2003, 05:10 PM
Tell the truth, Boss. The ladies only threads brought LGC crashing down, didn't they? :wink: :D

:lol: :lol: double laugh for you crazy very good

moonstomper
03-17-2003, 05:10 PM
Tell the truth, Boss. The ladies only threads brought LGC crashing down, didn't they? :wink: :D

:lol: :lol: double laugh for you crazy very good

moonstomper
03-17-2003, 05:10 PM
Tell the truth, Boss. The ladies only threads brought LGC crashing down, didn't they? :wink: :D

:lol: :lol: double laugh for you crazy very good

HurricaneJedi
03-18-2003, 01:43 AM
Ahhhh my old sn was taken... :sad: .. oh well i guess that is what happens when I don't post much anymore.

formerly known from long ago: EyeOfTheStorm

HurricaneJedi
03-18-2003, 01:43 AM
Ahhhh my old sn was taken... :sad: .. oh well i guess that is what happens when I don't post much anymore.

formerly known from long ago: EyeOfTheStorm

HurricaneJedi
03-18-2003, 01:43 AM
Ahhhh my old sn was taken... :sad: .. oh well i guess that is what happens when I don't post much anymore.

formerly known from long ago: EyeOfTheStorm

AbNormal27
03-19-2003, 02:29 PM
Any chance of the chat room coming back?

Aaryn

AbNormal27
03-19-2003, 02:29 PM
Any chance of the chat room coming back?

Aaryn

AbNormal27
03-19-2003, 02:29 PM
Any chance of the chat room coming back?

Aaryn

Caniac
03-19-2003, 02:42 PM
Chat room will be back as soon as I get the chance to do it. :)

Caniac
03-19-2003, 02:42 PM
Chat room will be back as soon as I get the chance to do it. :)

Caniac
03-19-2003, 02:42 PM
Chat room will be back as soon as I get the chance to do it. :)

AbNormal27
03-19-2003, 02:51 PM
No rush, you are still busy. I was just curious. Has all this driven you to drink yet?

Aaryn

AbNormal27
03-19-2003, 02:51 PM
No rush, you are still busy. I was just curious. Has all this driven you to drink yet?

Aaryn

AbNormal27
03-19-2003, 02:51 PM
No rush, you are still busy. I was just curious. Has all this driven you to drink yet?

Aaryn