Please whitelist cPanel in your adblocker so that you’re able to see our version release promotions, thanks!

The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Deduplication not working?

Discussion in 'Data Protection' started by brt, Dec 6, 2017.

Tags:
  1. brt

    brt Well-Known Member

    Joined:
    Jul 9, 2015
    Messages:
    77
    Likes Received:
    5
    Trophy Points:
    8
    Location:
    MN
    cPanel Access Level:
    Root Administrator
    Does anyone else feel that deduplication on remote server (rsync via ssh) isn't working properly?

    For example, I've got one cPanel server that's backing up locally to /backup and /backup is right around ~500GB but the same server's off-site (supposedly deduped) backup uses a full ~1TB.

    I realize that checking utilization when deduplicating is different, but the 1TB drive this server is backing up to reports full and backups fail, so I presume it's using the full 1TB.

    Does anyone else have similar happening? Any insight?
     
  2. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    41,502
    Likes Received:
    1,616
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Hello,

    Could you let us know the contents of your /var/cpanel/backups/config file?

    Thank you.
     
  3. hicom

    hicom Well-Known Member

    Joined:
    May 23, 2003
    Messages:
    279
    Likes Received:
    2
    Trophy Points:
    168
    Hi, we noticed the same thing. When using Incremental Backup option, it seems RSYNC is copying all data:

    On Local Server:
    du -sh *
    11G 2017-12-03
    22G 2017-12-05
    575M 2017-12-06
    16K lost+found
    11G monthly
    11G weekly

    On RSYNC Server:
    du -sh *
    22G 2017-12-05
    22G 2017-12-06

    /var/cpanel/backups/config:
    Code:
    BACKUPACCTS: 'yes'
    BACKUPBWDATA: 'yes'
    BACKUPDAYS: 0,2,3,4,5,6
    BACKUPDIR: /backup
    BACKUPENABLE: 'yes'
    BACKUPFILES: 'yes'
    BACKUPLOGS: 'no'
    BACKUPMOUNT: 'no'
    BACKUPSUSPENDEDACCTS: 'no'
    BACKUPTYPE: incremental
    BACKUP_DAILY_ENABLE: 'yes'
    BACKUP_DAILY_RETENTION: 3
    BACKUP_MONTHLY_DATES: 1
    BACKUP_MONTHLY_ENABLE: 'yes'
    BACKUP_MONTHLY_RETENTION: 3
    BACKUP_WEEKLY_DAY: 0
    BACKUP_WEEKLY_ENABLE: 'yes'
    BACKUP_WEEKLY_RETENTION: 3
    CHECK_MIN_FREE_SPACE: 1
    ERRORTHRESHHOLD: 3
    FORCE_PRUNE_DAILY: 0
    FORCE_PRUNE_MONTHLY: 0
    FORCE_PRUNE_WEEKLY: 0
    GZIPRSYNCOPTS: --rsyncable
    KEEPLOCAL: 1
    LINKDEST: 0
    LOCALZONESONLY: 'no'
    MAXIMUM_RESTORE_TIMEOUT: 21600
    MAXIMUM_TIMEOUT: 7200
    MIN_FREE_SPACE: 5
    MIN_FREE_SPACE_UNIT: percent
    MYSQLBACKUP: accounts
    POSTBACKUP: 'no'
    PREBACKUP: -1
    PSQLBACKUP: 'no'
    
    
     
  4. cPanelMichael

    cPanelMichael Forums Analyst
    Staff Member

    Joined:
    Apr 11, 2011
    Messages:
    41,502
    Likes Received:
    1,616
    Trophy Points:
    363
    cPanel Access Level:
    Root Administrator
    Hello,

    Remote incremental backups make use of hard links, so it might seem like disk space is utilized when it's actually not:

    How do the backups work exactly?

    That said, feel free to open a support ticket using the link in my signature so we can take a closer look if you're sure the files are duplicated.

    Thank you.
     
Loading...

Share This Page