Home
danny_valentini's Friends
 
[Most Recent Entries] [Calendar View] [Friends View]

Below are the most recent 10 friends' journal entries.

    Monday, December 14th, 2009
    draconiaonline
    [ threnodaemis ]
    1:32p
    Wednesday, December 9th, 2009
    furaffinity
    [ thevirtualcat ]
    3:23a
    Site back online.
    You probably knew that already, though.
    Tuesday, December 8th, 2009
    furaffinity
    [ thevirtualcat ]
    1:38p
    Forums are back online.
    Thanks to Carenath donating space on his server, the forums are back online.

    Now, I will preemptively answer some questions.

    • This wasn't done earlier because I didn't have the data off the old forum server until late, late Sunday night.
    • No, we can't use Carenath's server to bring the mainsite up. The main site is about a thousand times larger than the forums. (Both in terms of disk space and bandwidth requirements.)
    • We have everything we need to install the servers at the new facility. The only concern now is weather related, but that shouldn't be a problem. (Incidentally, did you know that studded tires are illegal in Maryland? This is highly relevant.)
    Monday, December 7th, 2009
    furaffinity
    [ preyfar ]
    5:33p
    Good News, Bad News, Good News, Bad News
    Good News: We're all ready to go on our end. We have the IPs, we've got the rack setup at our new colo. All we need to do is move our servers into the facility, update the IPs and config the DNS. That'll take maybe 30 to 45 minutes.

    Bad News: Switch and Data (hey, remember them?) were not able to process our badges in time, so we're not able to get into the colo. Yet. Fuck. You may proceed to queue the "BADGES?! WE DON'T NEED NO STEENKIN' BADGES!" quotes, because... that's the only thing holding us up. THE ONLY THING. Only thing. Yep. That. That thing? That's the only thing. THE. ONLY. THING.

    Only thing.

    Good News: Net-cat and myself (and maybe Dax) will be meeting at the colo at 5:00PM EST tomorrow to setup, install, configure and bring Fur Affinity online. We had hoped to do this today, but Murphy's Law is a fickle bitch unfortunately the paperwork pushers didn't pushpushpush.

    Bad News: I'm out of Cherry Bawls. FFFFFFFFFFFFFFFFFFFFFFFFFFFF

    Current Mood: annoyed
    Current Music: Little Big Planet Soundtrack - Horny Old Man
    draconiaonline
    [ threnodaemis ]
    4:55p
    lj_maintenance
    [ mhwest ]
    1:15p
    Notification System
    **FINAL EDIT Thu Dec 10 02:15:47 UTC 2009**

    So there is the final update... Over the past day we have processed around 11 million jobs out of the 12 million that were in queue at that time. Please bear in mind that over this past day, more jobs for notifications are also created. So while the queue has been dropping, we are still not fully caught up at this point, due to backlog and new jobs. We have roughly 3 million jobs still pending that involve the notification system in some manner. We had hoped we could have fully cleared the queue in a day, but unfortunately we can't clear it too quickly, since we need the rest of the site to operate normally. From our current perspective on the amount of jobs that are left in queue, and how many it has processed thus far, we believe it will take around another 8 - 12 hours to process everything.

    And finally some answers to some questions:

    Read More and Get Some Answers... )

    Current Mood: grumpy
    furaffinity
    [ preyfar ]
    12:55a
    FA Status Update
    Just a note:
    Net-Cat drove over to my place tonight and we did pre-maintenance on FA's servers (Tiamat, Bahamut, Trogdor and Novastorm) and all systems are good to go. We updated some of the software on Novastorm (VMWare) to the latest version.

    As of right now, everything is solid on our end. We are currently waiting for the colo facility to process our paperwork and get the billing process started. That's our only hold up right now. :) No, we do not have an ETA at this time, but we're still on track for our original forecasts. Again, everything is good to go on our side.

    At this point it's all paperwork.
    Friday, December 4th, 2009
    furaffinity
    [ preyfar ]
    2:53p
    It looks like we're planning to bring the site up Monday night. While we were originally aiming for this weekend, we're currently waiting on the paperwork to process at our new colo facility. While the tech team works 24/7 the back office team is a 9-5 crew. This may turn out to be a good thing as they are expecting snow, and the first snow of the season can usually be kind of hazardous road condition wise. =P

    We'll keep you updated as usual.

    On the plus side here's the good news: we're upgrading to a 100Mbit dedicated line, which is roughly 25% more bandwidth. In addition, our new deal allows Fur Affinity to operate its main data center at roughly 40% cheaper costs. This will allow us to further invest money into better hardware, upgrades and permit us to do off-site backups.

    (Note: With all due respect to Canada, our new colo facility shall remain in Virginia.)
    furaffinity
    [ preyfar ]
    12:16a
    Fur Affinity will be returning [this space intentionally left blank]*.

    * Update shall be later tomorrow to fill in the gap

    ---------------------

    I was able to down to the root of things. The entire outage goes down to a hardware problem on XO Communications. XO Communications did not have replacement hardware for the fiber lines that went down, and had to order it. Much like Comcast, when they say "we'll have a technician there at 2pm" and by the time 6pm rolls around he hasn't shown up, XO Communications dropped by ball.

    The entire issue was supposed to have been fixed by Tuesday night. This entire outage can, should and will be blamed on them. I'm not going to excuse the total lack of communication on our host's part, but that's another story altogether.

    I sincerely apologize for the outage, the inconvenience and frustration this has caused. This is not how we want FA to be known, and we've been striving to improve everything, and we'll be doing just that in the coming months.

    I have more I could say, and say venomously, but I'm going to hold my tongue. I've been working on FA and pulling servers up until midnight. I'm tired, and shall retire to bed. For now, adieu.
    Wednesday, December 2nd, 2009
    lj_maintenance
    [ mhwest ]
    12:18p
    MogileFS Maintenance
    **EDIT Thu Dec 3 23:24:15 UTC 2009 **

    Hey Everyone, we are about to run the last alter job that we need to on our database servers. This will effect userpics / scrapbook / vgift images for the next few hours. Have no fear, your images aren't lost, there is just a really intensive process running on the servers which store the information for mogilefs. Thank you for your understanding and all the LJ love...

    Hey LJers,

    I just wanted to let you all know that we are going to be performing some mogilefs maintenance over the next few days. We will be upgrading our current version to latest stable as well as changing some db config information to better handle the amount of files we are currently hosting. This shouldn't cause a big impact on site stability, but you may see some minor delays with userpic / scrapbook images appearing or other requests associated with our mogilefs. We would love to not have that happen, but unfortunately with some of the steps we need to take we have to cause a delay with images. I figured this was a better solution than taking down all of LiveJournal because well lets face it, we all need our daily LJ fix ;)

    Thanks,

    Current Mood: dirty
    Current Music: Bad Religion - Stranger Than Fiction
2wcOnline.com   About LiveJournal.com

Advertisement