The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Peformance Issue (gzipping on a NFS partition)

Discussion in 'Data Protection' started by phoenixweb, Jun 24, 2013.

  1. phoenixweb

    phoenixweb Well-Known Member

    Joined:
    Jun 3, 2004
    Messages:
    68
    Likes Received:
    0
    Trophy Points:
    6
    cPanel Access Level:
    DataCenter Provider
    Backup Performance Issue (gzipping on a NFS partition)

    Hello everybody,

    i'm experimenting a performance issue on my Backup Server due to the way cpanel makes backup.

    THE LANDSCAPE:
    • On my network I have a local backup server which I use to store backups of all my cpanel server (about 20).
    • The speed of the internal Network is 1Gb LAN ethernet on a dedicated netcard.
    • Every cPanel Server have a NFS mount on "/backup" which is a dir created on the backup server


    WHAT CPANEL DO DURING A BACKUP:
    1. Start making a copy of the account within "/backup/day/username/" which mean:
      -> SEND DATA TO THE BACKUP SERVER
    2. gZip/pigZip the whole content of the directory created "/backup/day/username" which mean:
      <- READ IN STREAMING SINGLE FILE FROM THE BACKUP SERVER
      <-> PERFORM THE COMPRESSION DURING THE STREAMING
      -> WRITE THE FINAL GZIP FILE TO THE BACKUP SERVER

    This affect the performance on the internal network smoothly in case of 1 server, but with 20 server you are gonna to kill the performance of every NFS mounts by filling up all the bandwith connections.

    THE AWKARD TEMPORARY SOLUTION:
    The awkard solution is to make the local backup on a different dir "/backup_tmp" and place the NFS backup dir on the alternate destination settings. Which means that i cannot use the new restore system AT ALL.

    I think cPanel should make the whole "backup process" in a local tmp dirs and after move to the default local backup directory (which is the one used for restoring backup).

    In order to fix there are two possibilities:
    - use a tmp directory to backup till the gzip compression (avoid compression on a NFS network)
    - or give the possibility to add local restore directory in order to see the backup on alternative destination


    Thanks,
    Massimiliano Cuttini
     
    #1 phoenixweb, Jun 24, 2013
    Last edited: Jun 24, 2013
  2. phoenixweb

    phoenixweb Well-Known Member

    Joined:
    Jun 3, 2004
    Messages:
    68
    Likes Received:
    0
    Trophy Points:
    6
    cPanel Access Level:
    DataCenter Provider
    Re: Backup Performance Issue (gzipping on a NFS partition)

    My awkard solution doesn't work well as it will break up also the retention system.
    I cannot delete old backups everyday of my life.

    I think this is a real big problem.
     
  3. phoenixweb

    phoenixweb Well-Known Member

    Joined:
    Jun 3, 2004
    Messages:
    68
    Likes Received:
    0
    Trophy Points:
    6
    cPanel Access Level:
    DataCenter Provider
    I have tried to open a Feature Request, but it was refused by telling me to use the same workaround I have done here.
    The problem is that i'm gonna miss this feature by using an alternative destination:

    1) Cannot use the restore system
    2) Cannot retent/rotate log, i need to delete manually the files (everyday?)
    3) System files are NOT moved but are leaved on the temp backup dir

    Is there anybody from cPanel that can help me to solve this issue?
    I understand that this problem can show only having many cpanel server, but the point is that cpanel should encorauge having many ;)

    Thanks,
    Massimiliano Cuttini
     
  4. ThinIce

    ThinIce Well-Known Member

    Joined:
    Apr 27, 2006
    Messages:
    346
    Likes Received:
    7
    Trophy Points:
    18
    Location:
    Disillusioned in England
    cPanel Access Level:
    Root Administrator
    It might be worth submitting a ticket so it's also logged from a support perspective, I can sort of understand why a feature request would be rejected on this, but having backup as an NFS mount isn't that unusual a use case from what I've seen in the past.
     
  5. phoenixweb

    phoenixweb Well-Known Member

    Joined:
    Jun 3, 2004
    Messages:
    68
    Likes Received:
    0
    Trophy Points:
    6
    cPanel Access Level:
    DataCenter Provider
    Thanks ThinIce,

    i have already submitted a support request, which is under investigation.
    I'll post here updates if any
     
  6. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,678
    Likes Received:
    648
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    Could you let us know the ticket number so we can update this thread with the outcome?

    Thank you.
     
  7. phoenixweb

    phoenixweb Well-Known Member

    Joined:
    Jun 3, 2004
    Messages:
    68
    Likes Received:
    0
    Trophy Points:
    6
    cPanel Access Level:
    DataCenter Provider
    Hi Michael,

    the support Request is Id 4276941 - Backup Performance Issue (gzipping on a NFS partition)
    the internal case is 71461

    The issue has been well explained by Gary Stanley:

     
  8. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,678
    Likes Received:
    648
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    There is a new case open to document the fact that the new backup system does all of its work under the default backup destination. For reference, the case number is 71749. While there are currently no immediate plans to change this behavior, I encourage you to open a feature request for this at:

    Submit A Feature Request

    You mentioned opening a feature request in the past. Could you let us know the specific link to that feature request?

    Thank you.
     
  9. phoenixweb

    phoenixweb Well-Known Member

    Joined:
    Jun 3, 2004
    Messages:
    68
    Likes Received:
    0
    Trophy Points:
    6
    cPanel Access Level:
    DataCenter Provider
    Everybody told me the same and I already did it BUT It had been refused!
    Take a look below.

    It's silly that everybody tell me to open a bug, open a feature request and cPanel refuse me both bug and feature request...... then? What's this for?
    :confused:


     
  10. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,678
    Likes Received:
    648
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    I can't find that feature request at features.cpanel.net. Do you have the full URL for the request so we can review where it was declined?

    Thank you.
     
  11. phoenixweb

    phoenixweb Well-Known Member

    Joined:
    Jun 3, 2004
    Messages:
    68
    Likes Received:
    0
    Trophy Points:
    6
    cPanel Access Level:
    DataCenter Provider
    It had been declined by cPanel moderation.
    As declined it was not admitted on feature portal.

    I have only a simple email in my inbox from cPanel Feature:

    Message-Id: <20130625120027.22942.1292754617.swift@features.cpanel.net>
    From: cPanel Feature Requests
    Reply-To: - removed -
    Auto-Submitted: auto-generated
    Precedence: bulk
    Subject: This feature request was rejected. Reason: This capability already exists in the new backup system in 11.38. 1. Set your default backup directory to a chosen working directory2. Uncheck the box labeled "Retain backups in the default backup directory."3. Add an Additional Local Directory destination that corresponds to the mount point for your NFS mount.
    To: - removed -
    Date: Tue, 25 Jun 2013 12:00:28 +0000
     
  12. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    30,678
    Likes Received:
    648
    Trophy Points:
    113
    cPanel Access Level:
    Root Administrator
    Feel free to resubmit that feature request. I contacted our feature request moderators to let them know about this specific request and I have been assured it will be allowed through this time.

    Thank you.
     
Loading...

Share This Page