The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

My disk storage increased over night

Discussion in 'General Discussion' started by yamaharr1, Mar 13, 2008.

  1. yamaharr1

    yamaharr1 Well-Known Member

    Joined:
    Jun 22, 2007
    Messages:
    91
    Likes Received:
    0
    Trophy Points:
    56
    My disk storage went from 17% to 47% over night. Where do I begin to find out what files took up so much space in 1 night?

    The changes I made since then was I installed the Chirpy firewall.

    I looked in the users accounts list and none of them show any big increases.

    How do I check to see if it is MySQL or even the email? If it was email then it should show in the users over all account I think.

    Any help would be great because by tomorrow my disk will be full
     
    #1 yamaharr1, Mar 13, 2008
  2. karrotx

    karrotx Member

    Joined:
    Nov 10, 2006
    Messages:
    18
    Likes Received:
    0
    Trophy Points:
    151
    If you installed the Chirpy firewall (APF?), the large increase is, most likely, due to logs. Try turning debugging down.
     
    #2 karrotx, Mar 17, 2008
  3. mctDarren

    mctDarren Well-Known Member

    Joined:
    Jan 6, 2004
    Messages:
    664
    Likes Received:
    2
    Trophy Points:
    168
    Location:
    New Jersey
    cPanel Access Level:
    Root Administrator
    CSF (not APF, by the way, that's someone else) logs are doubtful as the culprit so quickly, though you never know. Did you also install the ConfigServer MailScanner set up? High load mail servers can fill up the Mysql database for that set up quite quickly.

    Do a scan to see what files are so big:
    Code:
    find '/' -size +70000
     
    #3 mctDarren, Mar 17, 2008
  4. yamaharr1

    yamaharr1 Well-Known Member

    Joined:
    Jun 22, 2007
    Messages:
    91
    Likes Received:
    0
    Trophy Points:
    56
    I found that some of the incresed file storage was because of a mess up with the backups so there where multiple back ups stored in different places they where removed the same day as posting the first message so that still means there is a different of 15GB used within that 24 hours. I also noticed that since I installed chirpy firewall I no longer have access to the admin for fantastico.

    I looked through the firewall log files and they are very small.

    I do not have the mail scanner installed.

    I ran a scan and found most of the files that where found came from the back ups in which I had already known about the others I have listed below if anyone knows if I can remove some of them let me know.

    Code:
    /var/lib/mysql/#sql_1a6b_104.MYD
/var/lib/mysql/#sql_1a6b_96.MYD
/var/lib/mysql/#sql_1a6b_91.MYD
/var/cpanel/perl/easy/Cpanel/Easy/ModJk5.pm.tar.gz
/usr/lib/rpmdb/i386-redhat-linux/CentOS/Packages
/usr/lib/locale/locale-archive
/usr/tmpDSK
/proc/kcore
     
    #4 yamaharr1, Mar 18, 2008
  5. mctDarren

    mctDarren Well-Known Member

    Joined:
    Jan 6, 2004
    Messages:
    664
    Likes Received:
    2
    Trophy Points:
    168
    Location:
    New Jersey
    cPanel Access Level:
    Root Administrator
    The MYD files, locale-archive, tmpDsk and kcore need to stay. You'll probably recover a lot from those MYD files if you optimize those tables in mysql or phpmyadmin.

    Try "yum clean" to get rid of the Packages file.

    Not certain of the perl module file.. looks like EA related. It's late, so I'm running on fumes, but I don't think you should remove those files until you hear from someone else to confirm I'm correct. :)
     
    #5 mctDarren, Mar 18, 2008
  6. yamaharr1

    yamaharr1 Well-Known Member

    Joined:
    Jun 22, 2007
    Messages:
    91
    Likes Received:
    0
    Trophy Points:
    56
    "clean" requires an option: headers, packages, cache, metadata, all

    I have never used this comand which one should I tell yum to clean?

    Thanks
     
    #6 yamaharr1, Mar 18, 2008
  7. mctDarren

    mctDarren Well-Known Member

    Joined:
    Jan 6, 2004
    Messages:
    664
    Likes Received:
    2
    Trophy Points:
    168
    Location:
    New Jersey
    cPanel Access Level:
    Root Administrator
    yum clean all
     
    #7 mctDarren, Mar 18, 2008
  8. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,141
    Likes Received:
    3
    Trophy Points:
    68
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    Maybe the backups are using a bad configuration. I have suffered something similar to this situation before.
    Backups files use less space if you set the daily retention only and disable incremental backups. that way, may the backups spend more time building each one, but will be finally compressed, one file a domain, and you'll save much more space :)
     
    #8 Kent Brockman, Mar 18, 2008
  9. yamaharr1

    yamaharr1 Well-Known Member

    Joined:
    Jun 22, 2007
    Messages:
    91
    Likes Received:
    0
    Trophy Points:
    56
    I have the back ups all taken care of now it is just that 15GB increase I can not account for.

    I don't want to assume it is from the install of the firewall.
     
    #9 yamaharr1, Mar 18, 2008
  10. Kent Brockman

    Kent Brockman Well-Known Member

    Joined:
    Jan 20, 2008
    Messages:
    1,141
    Likes Received:
    3
    Trophy Points:
    68
    Location:
    Buenos Aires, Argentina
    cPanel Access Level:
    Root Administrator
    Twitter:
    did you tried find '/' -size +70000 suggested by serversphere to find out where are the greater files?

    This big increase of data happened just one time?
     
    #10 Kent Brockman, Mar 18, 2008
  11. nyjimbo

    nyjimbo Well-Known Member

    Joined:
    Jan 25, 2003
    Messages:
    1,125
    Likes Received:
    0
    Trophy Points:
    166
    Location:
    New York
    Unless I am missing something you dont mention what partition is bigger or what shows you using up the extra gigs. Where is the sudden growth in file usage, what partition ?


    Check the contents of /var/spool/exim/db

    A couple weeks ago we had a "ratelimit" file in there that suddenly jumped 4 gigabytes in one day. We deleted it and it now grows alot slower. It might be something in there.
     
    #11 nyjimbo, Mar 18, 2008
  12. yamaharr1

    yamaharr1 Well-Known Member

    Joined:
    Jun 22, 2007
    Messages:
    91
    Likes Received:
    0
    Trophy Points:
    56
    @ Kent Brockman yes I did and I listed the files in my second post. I also followed "serversphere" next post.

    @ nyjimbo that is the problem I do not know where the sudden file usage came from. I have a single 140GB disk with clients that was standing at 17% the last time I checked, then I installed the firewall and the very next day I checked the capacity and it went from 17% to 47% in a manner of 8 hours. I noticed this change because everyday I go into WHM and check drive capacity.

    There was a problem with the backups but I have taken care of that and right now I am looking at a lost of 15GB.

    All of my client accounts are not holding that many files nor are there plans that big so even if a few clients uploaded files it would be noticable through the client list which I watch everyday.
     
    #12 yamaharr1, Mar 18, 2008
  13. nyjimbo

    nyjimbo Well-Known Member

    Joined:
    Jan 25, 2003
    Messages:
    1,125
    Likes Received:
    0
    Trophy Points:
    166
    Location:
    New York
    Ok, but did you get a chance to do this:

    Where is the sudden growth in file usage, what partition ?
    Check the contents of /var/spool/exim/db
     
    #13 nyjimbo, Mar 18, 2008
  14. yamaharr1

    yamaharr1 Well-Known Member

    Joined:
    Jun 22, 2007
    Messages:
    91
    Likes Received:
    0
    Trophy Points:
    56
    I just read your response and I am looking into it now.
     
    #14 yamaharr1, Mar 18, 2008
  15. yamaharr1

    yamaharr1 Well-Known Member

    Joined:
    Jun 22, 2007
    Messages:
    91
    Likes Received:
    0
    Trophy Points:
    56
    What is it that I should be looking for?

    If it is a large file then shouldn't it have turned up when I did what serversphere suggested.
     
    #15 yamaharr1, Mar 18, 2008
  16. yamaharr1

    yamaharr1 Well-Known Member

    Joined:
    Jun 22, 2007
    Messages:
    91
    Likes Received:
    0
    Trophy Points:
    56
    I have a "ratelimit" file in there also but when I open it there isn't much info in there.
     
    #16 yamaharr1, Mar 18, 2008
  17. nyjimbo

    nyjimbo Well-Known Member

    Joined:
    Jan 25, 2003
    Messages:
    1,125
    Likes Received:
    0
    Trophy Points:
    166
    Location:
    New York
    Are you familiar with working around in the command prompt?. What we are looking for is file sizes that are in the gigabytes, as per my previous couple of messages. If you are not familiar with how to check this you might want to have someone else look at your computer for you.
     
    #17 nyjimbo, Mar 18, 2008
  18. yamaharr1

    yamaharr1 Well-Known Member

    Joined:
    Jun 22, 2007
    Messages:
    91
    Likes Received:
    0
    Trophy Points:
    56

    Sorry I didn't see that in your posts and I gave up mind reading years ago :)


    callout 12.0k
    misc 12.0k
    ratelimit 9.7M
    ratelimit.lockfile 0
    retry 24.0k
    retry.lockfile 0
    wait-remote_smtp 12.0k
    wait-remote_smtp.lockfile 0
     
    #18 yamaharr1, Mar 19, 2008
(You must log in or sign up to post here.)
Loading...
Similar Threads - disk storage increased
  1. Erik Ellsinger

    New Thread Log webdisk usage

    Erik Ellsinger, Jun 26, 2017 at 4:59 AM, in forum: General Discussion
    Replies:
    0
    Views:
    24
    Erik Ellsinger
    Jun 26, 2017 at 4:59 AM
  2. Wade John Beckett

    Reseller account disk space limits

    Wade John Beckett, Jun 18, 2017, in forum: General Discussion
    Replies:
    2
    Views:
    49
    cPanelMichael
    Jun 19, 2017
  3. Alex H

    Email disk usage

    Alex H, Jun 15, 2017, in forum: E-mail Discussions
    Replies:
    1
    Views:
    51
    cPanelMichael
    Jun 16, 2017
  4. Bashy

    var/tmp disk warning

    Bashy, May 26, 2017, in forum: General Discussion
    Replies:
    12
    Views:
    142
    Bashy
    Jun 20, 2017
  5. Cyril Macwilcy

    WebDisk Settings

    Cyril Macwilcy, May 12, 2017, in forum: General Discussion
    Replies:
    1
    Views:
    69
    cPanelMichael
    May 12, 2017

Share This Page