D.I.C slow?

  • (3 Pages)
  • +
  • 1
  • 2
  • 3

34 Replies - 4102 Views - Last Post: 15 March 2013 - 02:49 PM

#16 jon.kiparsky  Icon User is online

  • Pancakes!
  • member icon


Reputation: 7875
  • View blog
  • Posts: 13,357
  • Joined: 19-March 11

Re: D.I.C slow?

Posted 04 March 2013 - 08:56 AM

Ironically enough, it took almost two minutes to load this topic from the link in the email notification.
Was This Post Helpful? 0
  • +
  • -

#17 Martyr2  Icon User is offline

  • Programming Theoretician
  • member icon

Reputation: 4359
  • View blog
  • Posts: 12,176
  • Joined: 18-April 07

Re: D.I.C slow?

Posted 04 March 2013 - 11:40 PM

Yeah some of the ad serving CDNs that DIC uses are bottlenecking the site at times. If you add a bunch of them to your hosts file you can speed things up.

Then of course if you are here trying to answer questions between 11pm and 11:15pm PST you are going to run smack dab in the middle of the sites backing up and the whole site becomes unreachable.

The site is like dead man walkin.

This post has been edited by Martyr2: 04 March 2013 - 11:40 PM

Was This Post Helpful? 0
  • +
  • -

#18 skyhawk133  Icon User is offline

  • Head DIC Head
  • member icon

Reputation: 1876
  • View blog
  • Posts: 20,284
  • Joined: 17-March 01

Re: D.I.C slow?

Posted 05 March 2013 - 03:06 PM

Definitely can sympathize with everyone's frustration. It sucks to be paying more than my mortgage for servers are bogged down right now and issues with the site because we had to resort to extreme lock down measures to just keep the site running and from being hacked every morning.

I've tried numerous times to get the file uploads working, but the entire site right now is in a read-only state (files are chattr +i which means you can't modify them) and permissions have been reduced across the entire file structure. Finding the right combination of permissions that don't allow the vulnerable scripts from this old version of IPB we're on has been fruitless so far.

On the timeouts. I'm going to have our server team switch the site back to normal PHP. Right now it's mod_cgi/FastCGI I think, and that's when the problems started occurring last year.

I've looked at the cost to upgrade the site (paying someone to re-develop the sections of the site) to the latest version of IPB. But right now, with my current financial situation, it's not practical. (Looking at $20K+)

I'm trying to keep things semi-stable in the mean time. But right now, I can't even modify templates because the site is so locked down.

I do plan on bringing back the snippets area sooner than later though. So that should be resolve shortly.
Was This Post Helpful? 3
  • +
  • -

#19 skyhawk133  Icon User is offline

  • Head DIC Head
  • member icon

Reputation: 1876
  • View blog
  • Posts: 20,284
  • Joined: 17-March 01

Re: D.I.C slow?

Posted 05 March 2013 - 08:23 PM

I speced out a new server this evening with solid state drives. We'll look at migrating the site in the coming weeks. Will also look at the database server and switching that to SSDs as well.

Also, I'm having the server techs switch some things tonight that will hopefully get rid of the empty response errors.
Was This Post Helpful? 2
  • +
  • -

#20 Skydiver  Icon User is offline

  • Code herder
  • member icon

Reputation: 3617
  • View blog
  • Posts: 11,269
  • Joined: 05-May 12

Re: D.I.C slow?

Posted 06 March 2013 - 08:00 AM

I have very little experience managing a large active forum so I'm going to assume you know what you are doing. I'm just curious what the decision point was for deciding to scale up, rather than scale out. Was it simply the price point where adding a new front end server was about the same price of buying a new faster machine? Or is the backend database server just swamped with requests and the only choice was to scale up?

(This actually maybe an interesting discussion in the Software Development section. Hmmm...)
Was This Post Helpful? 1
  • +
  • -

#21 skyhawk133  Icon User is offline

  • Head DIC Head
  • member icon

Reputation: 1876
  • View blog
  • Posts: 20,284
  • Joined: 17-March 01

Re: D.I.C slow?

Posted 08 March 2013 - 09:31 AM

*
POPULAR

Just ordered 2 of these to be provisioned:

Dual Xeon E5-2620 Six-Core w/HT (12 Cores, 24 Threads)
- 32GB ECC Registered DDR3 Ram
- 4 x 128GB Samsung 840 PRO SSD
- Configured in hardware RAID-10


These are 60% faster than the current servers and with the Solid State Drives, page load times from the server should fly. Hoping this makes a significant improvement until we can actually tackle the underlying issues with the old code.
Was This Post Helpful? 5
  • +
  • -

#22 jon.kiparsky  Icon User is online

  • Pancakes!
  • member icon


Reputation: 7875
  • View blog
  • Posts: 13,357
  • Joined: 19-March 11

Re: D.I.C slow?

Posted 08 March 2013 - 09:37 AM

Huzzah!

Huzzah!

(oh, and can we do anything about this double-post problem? :) )

This post has been edited by jon.kiparsky: 08 March 2013 - 09:38 AM

Was This Post Helpful? 0
  • +
  • -

#23 skyhawk133  Icon User is offline

  • Head DIC Head
  • member icon

Reputation: 1876
  • View blog
  • Posts: 20,284
  • Joined: 17-March 01

Re: D.I.C slow?

Posted 08 March 2013 - 09:42 AM

I'm going to throw hardware at the problem first. Hopefully that fixes the hangs, slow loading, errors, etc.
Was This Post Helpful? 0
  • +
  • -

#24 BenignDesign  Icon User is offline

  • holy shitin shishkebobs
  • member icon




Reputation: 6174
  • View blog
  • Posts: 10,667
  • Joined: 28-September 07

Re: D.I.C slow?

Posted 08 March 2013 - 09:55 AM

View Postjon.kiparsky, on 08 March 2013 - 11:37 AM, said:

Huzzah!

Huzzah!

(oh, and can we do anything about this double-post problem? :)/> )



I'm pretty sure that's a PEBKAC error. :D
Was This Post Helpful? 0
  • +
  • -

#25 jon.kiparsky  Icon User is online

  • Pancakes!
  • member icon


Reputation: 7875
  • View blog
  • Posts: 13,357
  • Joined: 19-March 11

Re: D.I.C slow?

Posted 08 March 2013 - 10:04 AM

View PostBenignDesign, on 08 March 2013 - 11:55 AM, said:

View Postjon.kiparsky, on 08 March 2013 - 11:37 AM, said:

Huzzah!

Huzzah!

(oh, and can we do anything about this double-post problem? :)/>/> )



I'm pretty sure that's a PEBKAC error. :D/>


No, I have an error ticket here, says it's a known problem. Lemme see... "Error ID 10T" it says.
Was This Post Helpful? 1
  • +
  • -

#26 AdamSpeight2008  Icon User is offline

  • MrCupOfT
  • member icon


Reputation: 2267
  • View blog
  • Posts: 9,480
  • Joined: 29-May 08

Re: D.I.C slow?

Posted 08 March 2013 - 10:05 AM

View Postskyhawk133, on 08 March 2013 - 05:42 PM, said:

I'm going to throw hardware at the problem first. Hopefully that fixes the hangs, slow loading, errors, etc.


Try the threat of the kinetic persuader (aka the hammer) first.
Then look at a different algorithm instead of the current which seem like Onnn
Spoiler


Can you make it asynchronous? On both ends.

Or get a competition going on DIC going rewrite re-envision DIC.

This post has been edited by AdamSpeight2008: 08 March 2013 - 10:30 AM

Was This Post Helpful? 2
  • +
  • -

#27 Koyume  Icon User is offline

  • D.I.C Head

Reputation: 15
  • View blog
  • Posts: 89
  • Joined: 19-February 13

Re: D.I.C slow?

Posted 08 March 2013 - 02:02 PM

Let me ask this (Since I used to do this a while back). How big is the database size? Sometimes pruning inactive things (Spam accounts, etc) sometimes helps with loading pages and such (From my experience). Then again, those servers that you are planning on using (SSD's) should pick this place up a lot.

Even on a T1 line, I wait a bit on loading.
Was This Post Helpful? 0
  • +
  • -

#28 AdamSpeight2008  Icon User is offline

  • MrCupOfT
  • member icon


Reputation: 2267
  • View blog
  • Posts: 9,480
  • Joined: 29-May 08

Re: D.I.C slow?

Posted 08 March 2013 - 02:31 PM

Do you have Quantive Data on the performance? Breakdown of it?

So have you measured your DIC, skyhawk133?

This post has been edited by AdamSpeight2008: 08 March 2013 - 02:31 PM

Was This Post Helpful? 2
  • +
  • -

#29 Skydiver  Icon User is offline

  • Code herder
  • member icon

Reputation: 3617
  • View blog
  • Posts: 11,269
  • Joined: 05-May 12

Re: D.I.C slow?

Posted 10 March 2013 - 08:47 PM

Are the measurements when DIC is up, or when DIC is down? The numbers will probably be significantly different.
Was This Post Helpful? 1
  • +
  • -

#30 Takk  Icon User is offline

  • D.I.C Head

Reputation: 40
  • View blog
  • Posts: 111
  • Joined: 08-March 13

Re: D.I.C slow?

Posted 10 March 2013 - 09:27 PM

Actually with the empty responses and intermittent speed drops, it looks more like a packet issue. If this were a software issue or database issue, you would be getting more errors, or the pages would be consistently slow which isn't really the case at all.

I would check the load monitor on your current servers before you even spend the time transferring things over, http tends to be pretty light, and optimization on the database queries would likely cut back a good bit on them if you were getting high loads from there..

Given the empty responses and slow reaction times though, I'm leaning strongly towards the networking hardware being at fault, meaning the slow loads are coming from your connection waiting to be received, as opposed to waiting to be responded to.

Your admin's should be able to tell you pretty specifically where your load is sitting at peak times or throughout the day. httpd error log would tell you if it's constantly trying to recover from errors and/or passing them out..

There are a lot of options, and I don't feel like many end in 'not fast enough' as opposed to failed components.
Was This Post Helpful? 1
  • +
  • -

  • (3 Pages)
  • +
  • 1
  • 2
  • 3