cPanel backups impossible if >4GB or >50,000 Inodes?

[mailint]

I can't do cPanel backups with Hostgator because of one of these errors:

[ ! ] WARNING: Your account is TOO LARGE (Over 4gb) for cPanel backups. Please contact support. [ ! ]

[ ! ] WARNING: Your account is TOO LARGE (Over 50,000 Inodes) for cPanel backups. Please contact support. [ ! ]

Is it a limitation of cPanel?
What can I do to overcome this limitation?

 

[zigzam]

Looks like a limitation of Hostgator.

 

[cPanelKenneth]

This is not something we've implemented. You'll need to address your concerns to HostGator.

 

[jasonhk]

It's a hostgator limit:

http://www.hostgator.com/tos.shtml

7b.) INODES
The use of more than 250,000 inodes on any shared account may potentially result in a warning first, and if no action is taken future suspension. Accounts found to be exceeding the 50,000 inode limit will automatically be removed from our backup system to avoid over-usage. Every file (a webpage, image file, email, etc) on your account uses up 1 inode.

Sites that slightly exceed our inode limits are unlikely to be suspended; however, accounts that constantly create and delete large numbers of files on a regular basis, have hundreds of thousands of files, or cause file system damage may be flagged for review and/or suspension. The primary cause of excessive inodes seems to be due to users leaving their catchall address enabled, but never checking their primary account mailbox. Over time, tens of thousands of messages (or more) build up, eventually pushing the account past our inode limit. To disable your default mailbox, login to cPanel and choose "Mail", then "Default Address", "Set Default Address", and then type in: :fail: No such user here.

7c.) Backup Limit
Any shared account using more than 20 gigs of disk space will be removed from our off site weekly backup with the the exception of Databases continuing to be backed up. All data will continue to be mirrored to a secondary drive which helps protect against data loss in the event of a drive failure.

 

[exdiogene]

HostGator technical response to this issue...

First, i have to precise that the TOS article 7b) and 7c) are only about HostGator automated Weekly backups, not the users manual backups.

Anyway, it seem that HostGator is also limiting the users own backups.

The HostGator response to this is that it is cPanel that crash their servers when backing up more than 50000 inodes. Read their response here :

The reason is actually a limitation in cPanel. Instead of a "momentary" load this was actually crashing servers. You can still perform your own backups, you just can't use cPanels packaging script.

I am eager to know the cPanel technical response to that...

 

[cPanelDavidG]

First, i have to precise that the TOS article 7b) and 7c) are only about HostGator automated Weekly backups, not the users manual backups.

Anyway, it seem that HostGator is also limiting the users own backups.

The HostGator response to this is that it is cPanel that crash their servers when backing up more than 50000 inodes. Read their response here :



I am eager to know the cPanel technical response to that...

I have spoken to our Quality Assurance folks who specifically work on that functionality as well as our technical analysts and none of them have encountered the issue HostGator claims to be encountering with cPanel/WHM.

Additionally, our backup system runs at nice +19, meaning virtually all other processes on the server will execute before the next instruction for the backup is executed. This makes it extremely difficult for the backup system to overwhelm the cPanel/WHM server.

 

[exdiogene]

Thank you David for your reply...

This is what a HostGator Level 3 admin had to say about your answer :

"This makes it extremely difficult for the backup system to overwhelm the cPanel/WHM server."

That statement is relative when you have thousands of servers with hundreds of thousands of clients. Some having millions of files to archive, some having databases ranging up to 10gb.

For anyone with technical expertise in shared hosting, this should have been easily deduced by drawing a logical conclusion based on my previous reply.

Even with the process niced and even ionice'd (which we tried) sometimes the gzip / sql dump sections of packaging the account causes the load on our servers to reach alarmingly high levels that degrade the quality of service for other users. And that's why these limits are in place.

As an example say we have 5 users having each in their accounts :

- 100,000 files with a total size before compression of 750MB
- One database of 250MB

Do you really believe that if these 5 users decide to do their own backups of 1GB before compression at the same time, it wont be harmfull to a shared accounts server with 4 CPUs and 8GB of memory?

 

[cPanelDavidG]

This is what a HostGator Level 3 admin had to say about your answer :



As an example say we have 5 users having each in their accounts :

- 100,000 files with a total size before compression of 750MB
- One database of 250MB

Do you really believe that if these 5 users decide to do their own backups of 1GB before compression at the same time, it wont be harmfull to a shared accounts server with 4 CPUs and 8GB of memory?

We have many customers that do backups of accounts with 30+ Gigabytes of content. While these backups do take a while to generate, they do not use sufficient resources at a single time to bring a modern server (such as one you mention) to a crashed/hung state in our experience and testing.

Last week we had a customer on an old single-core system with 512 megs of RAM backing up over 25 Gigs of data from the whole server - but even such a low-powered system remained online, just operating slower than it normally would.

However, I can only speak for default cPanel/WHM installs, configurations options made possible by cPanel/WHM itself and the backup scripts we use as part of our migration automation. If significant custom modifications have been performed to servers running our software (e.g. by means of custom shell scripting), that potentially could interfere with our software performing in its intended fashion.

As for your specific scenario of 5 users pressing the full server backup simultaneously on a server with contemporary hardware - as all 5 processes would run at nice 19, it should not bring down the server. I've started up to 7 full site backup processes on a shared server with similar specifications (the 4 CPUs were each dual-core) without even slightly affecting server performance.

However, if you're worried about such a scenario, you may consider encouraging users do download their own system backups instead of generating new backups. Users can do this by going to the Backup section of their cPanel interface and select the "daily" backup under the "System Backups" section near the top of the screen. This only works if you have system backups enabled.

 

[Infopro]

Looks like a limitation of Hostgator.

Unlimited disk space hosting with limits on disk space? Go figure.

 

[mohit]

a Nice feature integrated with Unlimited Hosts,
A friendly suggestion, start backing up on own today before your loose everything, cause your host may not backup and will be hiding behind what their TOS says, not to mention you must have agreed while signing up.

 

[bodhost.com]

Well, that's the issue with most hosting companies. They don't offer what they mention on the website. There's always a catch with these providers even though their branding is quite impressive in the market, but yet lack what the customer requires.
__________________
Dedicated Server Hosting | vps hosting

 

[MN-Robert]

I'll have to disagree with you David. We've had to disable it also as large accounts were hogging IO for hours sometimes. We do provide R1soft now and don't have the same issues.

 

[cPanelDavidG]

I'll have to disagree with you David. We've had to disable it also as large accounts were hogging IO for hours sometimes. We do provide R1soft now and don't have the same issues.

Anyone encounters these issues on 11.23 or later, please submit a support ticket so we can take a look at things: http://tickets.cPanel.net/submit

If you are experiencing these issues on an older version of cPanel, upgrading will likely resolve the issue.

 

[exdiogene]

No more response from HostGator...

David,

i never had received any other response from HostGator after posting your reply.

Their version of cPanel is always the last one, now it is 11.24.4-RELEASE 36167.

So i wonder why they still refuse to allow their 1,800,000 domains to backup their sites when they reach the critical 50,000 inodes point even if these inodes have a total size under 500MB.

 

[MN-Robert]

You should consider changing hosts if their Inode limit is affecting you.

 

[nibb]

Thats the problem when you go with Unlimited hosts. They tend to put and invent all kind of limits so users dont eat all their resources.

The inode limit is actually to say "hey, you will run into troubles if you use more then 10 GB of space", so there is goes with the unlimited !!!

Go with a real host with real plans. Some hosts on which the features that cPanel has actually work. Example.

cPanel shows the total disk Usage and monthly Transfer. This features are null on this unlimited hosts.

It would be easier to say, hey, you have a 5 GB plan. You can use up to 5 GB, no inodes, not tricks, not hiding anything.

Then you would just see on your Cpanel. Ups, im using 4 GB.

The problem is they try to sell, sell, sell. So they invent all this unlimited plans, heavily modify their cPanel to work their way and limit almost all you can do. I have seing hosts that limit backup, others disable mailbox trapper, other disable spam assassin. Others disable virus scan. On the end whats the purpose of using such a wonderful control panel if your hosts is going to null it.

Go with a hosting that has real plans. There you will be able to use cPanel on its full extension. If unlimited plans exists, you can be sure Google would host on a cPanel server on a 20$ plan. They dont. 2000 GB bandwith doesnt cost 5$ a month. It costs hundreds. Same for disk. 10 GB disk dont cost 1$ a year. Its costs them money. So if you are on a provider where you actually pay for bandwith and space you will get a great service too.

 

[dwykofka]

This is where the artificial limits come into play. I can assure you that there are no problems with cpanel making nightly backups of accounts this size. Honestly it's not even that big, Some of my customers utilize 30+GB of disk without these "inode nightmares" that hostgator would have you believe.

Hostgator puts roughly 200 clients on each server. This normally wouldn't be an issue but in order to capture market share they advertise "too good to be true" packages that pull on the greed strings of consumers. In order to sustain this level of utilization they had to implement artificial limitations in their systems so that they could push their invisible package limitations down to customers without owning up to the fact that they are running the same hardware a everyone else and there is no magical endless resource box.

in short: Unlimited hosting is always limited in some fashion and it's a large indicator that this host is shady.

 

[Junkfriend]

Hostgator puts roughly 200 clients on each server..

I think you might want to add an extra "0" to the end :D

 

[caesar1]

my host cprvhost.com offer what's on our site. We do not offer unlimited

 

[dwykofka]

Since you brought it up... I guarantee that you cannot load 200GB of data on cprv for $11/mo. As a matter a fact if you can keep 200GB of data on CPRV for 3 months in a row I will eat my hat.