Filed with Developers Faster cPanel Backup by replacing gzip with pigz [Case 57803]

[Compubuster]

I have completed all these steps on my CENTOS 5.7 x86_64 server without any errors but still i am not able to use pigz

-bash-3.2# pigz -h
-bash: pigz: command not found
-bash-3.2# man pigz
No manual entry for pigz

Try gzip -h .. The above commands will replace gzip with pigz.

[Compubuster]

bhanuprasad1981, what's your OS ?

[bhanuprasad1981]

centos 5.7 64bit

[mov-ax-bx]

hi guys,

i was trying to replace sevaral scripts that uses zip and realize that pigz is supposed to replace gzip and not zip.
to cut the chase, the scripts that has the zip adds new log files to the existing zipped file which could not be done by gzip nor pigz. not unless i am not reading the man pages right.

if indeed gzip/pigz don`t supports the addition of new files to an existing compressed file, i am wondering if this is an opportunity to incorporate this feature.

let me know if this already been brought up on another thread.
could you please share with me the link if it`s handy.

thank you very much.

[Gareth-AWD]

+ 1 for this. Backtime is one of my pet hates on cPanel.

The whole backup process needs an overhaul with the ability to select certain users to less frequent backups.

[gunmuse]

Ok I did the untar of 2.2.3 assuming that is the latest version as 2.2.2 is all that is mentioned.

I cp it to replace my gzip an gunzip

Nothing appears broken.

Now I turned off certain backups because they were pigs who used up 25% of the servers time in the middle of the night when crons are trying to run.

My curiosity in doing this was the use of gzip compression by apache to serve Http pages. So my thinking was if pigz is 5 times faster as it appears would my use of gzip compression be 5 x faster as I am serving up pages?

Couldn't I set pigz to 9 (and how would I do that) for max compression for slow connection users to get maximum speed from us? Still be faster, save 5-15% bandwidth per month to boot?

I have tons of cpu cores and 32 gig of memory so I am wanting my server to do as much for my visitor as it can without impacting performance in some sort of run away.

And I would ask that adding gzip updates to exclusion list of YUM be a part of the "HOW TO" I love to copy and paste from well written how to's just lazy that way.

[gunmuse]

root@box2 [/usr/local/src/pigz-2.2.3]# cp pigz /bin/gzip
cp: overwrite `/bin/gzip', overriding mode 0755? y
cp: cannot create regular file `/bin/gzip': Permission denied
root@box2 [/usr/local/src/pigz-2.2.3]#

I don't seem to be able to actually move those files to replace gzip any reason why?

[gunmuse]

Shouldn't we be able to tell apache which compression program we want to use? Or is Gzip that engrained from time.

[Quemeros]

We really need this, it's a amazing change in CPU/Time process!

[satmagic]

+1 Vote for this

[oldengine]

Backtime is one of my pet hates on cPanel. The whole backup process needs an overhaul with the ability to select certain users to less frequent backups.

And another! I have reached 3/4 million posts on my forums and WHM backups are becoming awkward!

[nerdzoll]

Hey David,
Any more word on this? +++1 from me for this too
Stu

[cPanelDavidG]

Hey David,
Any more word on this? +++1 from me for this too
Stu

This is moving forward. The first place we're doing this is pkgacct, which has many implications as this script is used for account backups, account backups done as part of automatic server backups and account transfers. This is currently in QA and may become part of the first 11.33 builds once it goes to EDGE if all goes well.

[eva2000]

This is moving forward. The first place we're doing this is pkgacct, which has many implications as this script is used for account backups, account backups done as part of automatic server backups and account transfers. This is currently in QA and may become part of the first 11.33 builds once it goes to EDGE if all goes well.

does a little dance... awesome news

[cPanelDavidG]

Some additional details on the pigz implementation:

You will be able to set gzip/pigz options via a "Compression" section of Tweak Settings where you can:
- You can enable/disable pigz
- Define a compression level
- Define a number of pigz processes (default is the number of cores available, we do not factor the extracpus setting into this)
- Define Pigz work unit block size

We will enforce the use of sane values for all of these settings so you don't accidentally set a setting that makes things not work well.