WHM too slow with more then 700-1000 accounts !!!

[vovikIII]

On any server with more then 700-1000 accounts, all WHM accounts related features works _too slow_ and server load is terrible high. That happens probably because of not optimized algorithms of accounts text datafiles parsing (WHM still doesn't use any database).
So - even on the 2xPIII-1GHz with UW SCSI disks list accounts works up to 5-10 minutes (!!!) and server load is too high.

Are any workarounds exists ? (except taking off the list acocunts feature, anyway - create/remove account works too slow as well ((

I think it is very serious bug. And I'm sure I'm not the 1st person who tells about this terrible _bug_.

It would be great to hear CPanel/WHM development team response about the plans & estimated time for this thing fix.
The probable answer &please, submit the ticket& is not Ok - I had submited ticket about other problem several weeks ago, and it is still unanaswered at all.

Thank You

 

[bdraco]

[quote:cfa96ed4f7][i:cfa96ed4f7]Originally posted by vovikIII[/i:cfa96ed4f7]

On any server with more then 700-1000 accounts, all WHM accounts related features works _too slow_ and server load is terrible high. That happens probably because of not optimized algorithms of accounts text datafiles parsing (WHM still doesn't use any database).
So - even on the 2xPIII-1GHz with UW SCSI disks list accounts works up to 5-10 minutes (!!!) and server load is too high.

Are any workarounds exists ? (except taking off the list acocunts feature, anyway - create/remove account works too slow as well ((

I think it is very serious bug. And I'm sure I'm not the 1st person who tells about this terrible _bug_.

It would be great to hear CPanel/WHM development team response about the plans & estimated time for this thing fix.
The probable answer &please, submit the ticket& is not Ok - I had submited ticket about other problem several weeks ago, and it is still unanaswered at all.

Thank You
[/quote:cfa96ed4f7]

Something is seriously wrong with your server since listing 2000 accounts only takes about 12s on a celeron 1ghz

 

[vovikIII]

How much reseller accounts does your server have ?

I had tested this slowness on sevral different CPanel/WHM servers. And slowness always the same.

Please, guys, advice more.

I would want to take a look how is it shows 2000 accounts during the 12 seconds on the celeron.

I mean accounts, not just DNS zones.

Thanks

 

[SHSaeed]

It sounds to me that your server has a high load to start with. From my experience, WHM/CPanel load normally slower than normal sites on the server, but it shouldn't take 5-10 minutes to load a list unless the server load is way up high.

 

[vovikIII]

Thanks for reply, but server is not loaded. When there is no reselelrs activities (by WHM) - the server load average is about 0.3-0.5
The number of accounts: 2100
The number of resellers: 176
The number of resellers packages: 733
The number of IP aliases: 512

I think Cpanel guys had tested huge accounts number without so many IP aliases/reselelrs or packages.

 

[bdraco]

[quote:0ce77369ba][i:0ce77369ba]Originally posted by vovikIII[/i:0ce77369ba]

Thanks for reply, but server is not loaded. When there is no reselelrs activities (by WHM) - the server load average is about 0.3-0.5
The number of accounts: 2100
The number of resellers: 176
The number of resellers packages: 733
The number of IP aliases: 512

I think Cpanel guys had tested huge accounts number without so many IP aliases/reselelrs or packages.

[/quote:0ce77369ba]

Is it only the list account function that is slow for you?

 

[vovikIII]

Add account & remove account works too slow. Your developers seems tried &to speedup& remove account feature a bit wrong way - it spawns some background processes, but reports &Done&. After &Done& reported, anyway I see update domainips, convertemail, pwck, grpck, mkvhost... processes running...
I'm sure all those processes related exactly to the my attempt of account remove.

And of course I'm ready to provide server login info for your guys to see that it is really slow.

And the server load average (caused by httpd and pther usual processes ) is really low.

Imagine how it is bad to feel myself, when server theoretically can host twice more accounts, but WHM works too slow ((

Thank You

 

[YukFoo]

vovikIII,

Are your sites, yours, your resellers, and customers loading, fast? Slow? Normal? I'm curious on this. Interesting problem indeed.

 

[vovikIII]

Sites are loading fast. The load average (without resellers activity) is low (about 0.6-0.7).

Thanks

 

[bdraco]

vovikill, how large is your httpd.conf ?

ls -l /usr/local/apache/conf/httpd.conf

 

[vovikIII]

ls -l /usr/local/apache/conf/httpd.conf
-rw-r--r-- 1 root root 1016557 Sep 10 07:14 /usr/local/apache/conf/httpd.conf

wc -l /usr/local/apache/conf/httpd.conf
36470 /usr/local/apache/conf/httpd.conf

grep ^# /usr/local/apache/conf/httpd.conf| wc -l
807

grep ^$ /usr/local/apache/conf/httpd.conf| wc -l
6736

(!!! cpanel every time adds a lot of emty lines and fake NameVirtualHost directives - that is not good thing, but it is possible to live with it).

 

[bdraco]

I've got a new version if you'd like to test it for listing accounts

Here is the stats

Old version:

70.87user 2.39system 2:30.65elapsed 48%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (2357major+12424minor)pagefaults 0swaps

New Version:

1.35user 0.35system 0:03.76elapsed 45%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (2863major+3626minor)pagefaults 0swaps


(system has ~1700 accounts)

 

[vovikIII]

Wow! Just let me know, please, where is that new version ?
.....

Btw - does it fixes the list accounts only or add/remove accounts features as well ?

Thank You

 

[bdraco]

try build 23
--
only list accounts has changed (one thing at a time is much safer )

 

[vovikIII]

IMPRESSIVE !

Now it works 30 seconds for ~2200 accounts instead of 4-5minutes !

And 12-15seconds of 30 seconds were taken by repquota process...

Great work, guys !

 

[bdraco]

Any idea where its getting stuck/taking up the most time when killing/adding an account ?

 

[vovikIII]

The mosty slow process is updatedomainip

Thank You

 

[vovikIII]

And , please, try to do something with repquota process speed improvement

Thank You

 

[bdraco]

[quote:0fb3bd3712][i:0fb3bd3712]Originally posted by vovikIII[/i:0fb3bd3712]

And , please, try to do something with repquota process speed improvement

Thank You
[/quote:0fb3bd3712]

There isn't much I can do about that, but I will improve the updatedomainips script.

 

[vovikIII]

And the next candidate is updateuserdomain process.

Thank You a lot