Found corrupted backup metadata, scheduling backup metadata rebuild

ronyjames

Registered
Jun 13, 2019
2
0
1
india
cPanel Access Level
Root Administrator
Hi,

I got a notification regarding partial backup completion from cpanel as follows. Why this error occurred while taking backup?. How can i fix this.

Code:
=======================================================
The system started a separate transport process for remote backup destinations. When the
transport completes, the system will send an additional notification with the status of
the transport if any errors were encountered.

The backup process encountered the following error:

Some of the metadata database(s) appear corrupt. Scheduling a rebuild.

Review the attached log “/usr/local/cpanel/logs/cpbackup/1561394783..log” for further
details.

bin::backup::__ANON__() called at /usr/local/cpanel/bin/backup line 924
bin::backup::__ANON__() called at
/usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97
eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm
line 88
Try::Tiny::try(CODE(0x35cb158), Try::Tiny::Catch=REF(0x3611de0)) called at
/usr/local/cpanel/bin/backup line 934
bin::backup::_process_backups(HASH(0x335c9b0)) called at /usr/local/cpanel/bin/backup line
381
bin::backup::run("bin::backup") called at /usr/local/cpanel/bin/backup line 123
[2019-06-28 13:51:54 +0530] info [backup] Queuing daily backup copy of example€1 for
transport of “/backup/2019-06-24/accounts/example€1 to “2019-06-24/accounts/example€1
[2019-06-28 13:51:54 +0530] info [backup] This particular transport will be queued with
keep_local = 1 , based on the need to copy weekly () and/or monthly () copies as well.
[2019-06-28 13:51:54 +0530] info [backup] Queuing transport of file:
/backup/2019-06-24/accounts/example€1
[2019-06-28 13:51:54 +0530] info [backup] no_transport = 0 .. and queueid =
TQ:TaskQueue:1548
[2019-06-28 13:51:55 +0530] info [backup] leaving queue_backup_transport_item
[2019-06-28 13:51:55 +0530] info [backup] Queuing transport of meta file:
/backup/2019-06-24/accounts/.master.meta
[2019-06-28 13:51:55 +0530] info [backup] no_transport = 0 .. and queueid =
TQ:TaskQueue:1549
[2019-06-28 13:51:55 +0530] info [backup] leaving queue_backup_transport_item
[2019-06-28 13:51:55 +0530] info [backup] Pruning backup directory: /backup/2019-06-16
[2019-06-29 03:34:25 +0530] info [backup] Pruning backup directory: /backup/2019-06-23
[2019-06-29 17:01:01 +0530] info [backup] Queuing prune operation for remote destination
daily backups
[2019-06-29 17:01:01 +0530] info [backup] no_transport = 0 .. and queueid =
TQ:TaskQueue:1550
[2019-06-29 17:01:01 +0530] info [backup] leaving queue_backup_transport_item
[2019-06-29 23:19:46 +0530] info [backup] Found corrupted backup metadata, scheduling
backup metadata rebuild
[2019-06-29 23:19:47 +0530] info [backup] Queuing transport reporter
[2019-06-29 23:19:47 +0530] info [backup] no_transport = 0 .. and queueid =
TQ:TaskQueue:1551
[2019-06-29 23:19:47 +0530] info [backup] leaving queue_backup_transport_item
[2019-06-29 23:19:47 +0530] info [backup] Completed at Sat Jun 29 23:19:47 2019
[2019-06-29 23:19:47 +0530] info [backup] Final state is Backup::PartialFailure (0)
==========================================================
While checking the logs, we can find this.

Code:
===========================================================
pkgacct completed
[2019-06-28 12:44:41 +0530] info [backup] Successfully backed up account “example€1” to “/backup/2019-06-24/accounts”
[2019-06-28 12:44:41 +0530] info [backup] Adding metadata information for example€1 to backup at /backup/2019-06-24
[2019-06-28 12:44:41 +0530] info [backup] Processing an incremental type backup for example€1.
[2019-06-28 13:51:54 +0530] warn [backup] Caught Error Cpanel::Exception::Backup::CorruptedBackupData/(XID 4yfx6x) The system was unable to interpret backup data. Error: “Cpanel::Exception::Database::Error/(XID tjm2sx) The system received an error from the “SQLite” database “/backup/.meta/example€1.db”: SQLITE_BUSY (database is locked)
 at /usr/local/cpanel/Cpanel/DBI.pm line 200.
        Cpanel::DBI::_create_exception(Cpanel::DBI::SQLite::db=HASH(0x2db0570), "DBD::SQLite::db selectall_arrayref failed: database is locked", undef) called at /usr/local/cpanel/Cpanel/DBI.pm line 188
        Cpanel::DBI::_error_handler("DBD::SQLite::db selectall_arrayref failed: database is locked", Cpanel::DBI::SQLite::db=HASH(0x2db0570), undef) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1705
        Cpanel::Backup::Metadata::_backup_timestamp_exists(Cpanel::DBI::SQLite::db=HASH(0x2db0570), 1561334400) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 825
        Cpanel::Backup::Metadata::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97
        eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88
        Try::Tiny::try(CODE(0x343d790), Try::Tiny::Catch=REF(0x36ca178)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 928
        Cpanel::Backup::Metadata::_do_process_metadata("user", "example€1", "date", "2019-06-24", "path", "/backup/2019-06-24/accounts", "logger", Cpanel::Logger=HASH(0x354e780), ...) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 619
        Cpanel::Backup::Metadata::process_metadata_from_incremental("example€1", "2019-06-24", "/backup", Cpanel::Logger=HASH(0x354e780)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1064
        Cpanel::Backup::Metadata::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97
        eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88
        Try::Tiny::try(CODE(0x337bb20), Try::Tiny::Catch=REF(0x3414be0)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1069
        Cpanel::Backup::Metadata::create_metadata_for_backup_user("/backup/2019-06-24", "example€1", Cpanel::Logger=HASH(0x354e780)) called at /usr/local/cpanel/bin/backup line 1757
        bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97
        eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88
        Try::Tiny::try(CODE(0x3616230), Try::Tiny::Catch=REF(0x343dfd0)) called at /usr/local/cpanel/bin/backup line 1753
        bin::backup::backup_accounts("/backup/2019-06-24/accounts") called at /usr/local/cpanel/bin/backup line 917
        bin::backup::__ANON__() called at /usr/local/cpanel/bin/backup line 924
        bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97
        eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88
        Try::Tiny::try(CODE(0x35cb158), Try::Tiny::Catch=REF(0x3611de0)) called at /usr/local/cpanel/bin/backup line 934
        bin::backup::_process_backups(HASH(0x335c9b0)) called at /usr/local/cpanel/bin/backup line 381
        bin::backup::run("bin::backup") called at /usr/local/cpanel/bin/backup line 123
”.
 at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 926.
        Cpanel::Backup::Metadata::__ANON__(Cpanel::Exception::Database::Error=HASH(0x35d6b28)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 118
        Try::Tiny::try(CODE(0x343d790), Try::Tiny::Catch=REF(0x36ca178)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 928
        Cpanel::Backup::Metadata::_do_process_metadata("user", "example€1", "date", "2019-06-24", "path", "/backup/2019-06-24/accounts", "logger", Cpanel::Logger=HASH(0x354e780), ...) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 619
        Cpanel::Backup::Metadata::process_metadata_from_incremental("example€1", "2019-06-24", "/backup", Cpanel::Logger=HASH(0x354e780)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1064
        Cpanel::Backup::Metadata::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97
        eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88
        Try::Tiny::try(CODE(0x337bb20), Try::Tiny::Catch=REF(0x3414be0)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1069
        Cpanel::Backup::Metadata::create_metadata_for_backup_user("/backup/2019-06-24", "example€1", Cpanel::Logger=HASH(0x354e780)) called at /usr/local/cpanel/bin/backup line 1757
        bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97
        eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88
        Try::Tiny::try(CODE(0x3616230), Try::Tiny::Catch=REF(0x343dfd0)) called at /usr/local/cpanel/bin/backup line 1753
        bin::backup::backup_accounts("/backup/2019-06-24/accounts") called at /usr/local/cpanel/bin/backup line 917
        bin::backup::__ANON__() called at /usr/local/cpanel/bin/backup line 924
        bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97
        eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88
        Try::Tiny::try(CODE(0x35cb158), Try::Tiny::Catch=REF(0x3611de0)) called at /usr/local/cpanel/bin/backup line 934
        bin::backup::_process_backups(HASH(0x335c9b0)) called at /usr/local/cpanel/bin/backup line 381
        bin::backup::run("bin::backup") called at /usr/local/cpanel/bin/backup line 123
 at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1068.
        Cpanel::Backup::Metadata::__ANON__(Cpanel::Exception::Backup::CorruptedBackupData=HASH(0x3611cd8)) called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 118
        Try::Tiny::try(CODE(0x337bb20), Try::Tiny::Catch=REF(0x3414be0)) called at /usr/local/cpanel/Cpanel/Backup/Metadata.pm line 1069
        Cpanel::Backup::Metadata::create_metadata_for_backup_user("/backup/2019-06-24", "example€1", Cpanel::Logger=HASH(0x354e780)) called at /usr/local/cpanel/bin/backup line 1757
        bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97
        eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88
        Try::Tiny::try(CODE(0x3616230), Try::Tiny::Catch=REF(0x343dfd0)) called at /usr/local/cpanel/bin/backup line 1753
        bin::backup::backup_accounts("/backup/2019-06-24/accounts") called at /usr/local/cpanel/bin/backup line 917
        bin::backup::__ANON__() called at /usr/local/cpanel/bin/backup line 924
        bin::backup::__ANON__() called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 97
        eval {...} called at /usr/local/cpanel/3rdparty/perl/528/lib/perl5/cpanel_lib/Try/Tiny.pm line 88
        Try::Tiny::try(CODE(0x35cb158), Try::Tiny::Catch=REF(0x3611de0)) called at /usr/local/cpanel/bin/backup line 934
        bin::backup::_process_backups(HASH(0x335c9b0)) called at /usr/local/cpanel/bin/backup line 381
        bin::backup::run("bin::backup") called at /usr/local/cpanel/bin/backup line 123
[2019-06-28 13:51:54 +0530] info [backup] Queuing daily backup copy of “example€1” for transport of “/backup/2019-06-24/accounts/example€1” to “2019-06-24/accounts/example€1”
[2019-06-28 13:51:54 +0530] info [backup] This particular transport will be queued with keep_local = 1 , based on the need to copy weekly () and/or monthly () copies as well.
[2019-06-28 13:51:54 +0530] info [backup] Queuing transport of file: /backup/2019-06-24/accounts/example€1
[2019-06-28 13:51:54 +0530] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:1548
[2019-06-28 13:51:55 +0530] info [backup] leaving queue_backup_transport_item
[2019-06-28 13:51:55 +0530] info [backup] Queuing transport of meta file: /backup/2019-06-24/accounts/.master.meta
[2019-06-28 13:51:55 +0530] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:1549
[2019-06-28 13:51:55 +0530] info [backup] leaving queue_backup_transport_item
[2019-06-28 13:51:55 +0530] info [backup] Pruning backup directory: /backup/2019-06-16
[2019-06-29 03:34:25 +0530] info [backup] Pruning backup directory: /backup/2019-06-23
[2019-06-29 17:01:01 +0530] info [backup] Queuing prune operation for remote destination daily backups
[2019-06-29 17:01:01 +0530] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:1550
[2019-06-29 17:01:01 +0530] info [backup] leaving queue_backup_transport_item
[2019-06-29 23:19:46 +0530] info [backup] Found corrupted backup metadata, scheduling backup metadata rebuild
[2019-06-29 23:19:47 +0530] info [backup] Queuing transport reporter
[2019-06-29 23:19:47 +0530] info [backup] no_transport = 0 .. and queueid = TQ:TaskQueue:1551
[2019-06-29 23:19:47 +0530] info [backup] leaving queue_backup_transport_item
[2019-06-29 23:19:47 +0530] info [backup] Completed at Sat Jun 29 23:19:47 2019
[2019-06-29 23:19:47 +0530] info [backup] Final state is Backup::PartialFailure (0)
[2019-06-29 23:19:47 +0530] info [backup] Sent Backup::PartialFailure notification.
=========================================================
 
Last edited by a moderator:

cPanelLauren

Forums Analyst II
Staff member
Nov 14, 2017
6,815
541
263
Houston
cPanel Access Level
DataCenter Provider
Is this happening every time backups run or did it only happen the once? The instances in which I've seen this occur before was due to something on the remote filesystem - can you tell me about the remote backup destination?