rpmdb: /var/lib/rpm/__db.001: No space left on device

[remshad]

hi ,

my cpanel login does'does not appear in screen , it shows only loading .... but not loading fully
so i logged in ssh , and try to update software (i thought it may be any software issue)

it give me a junk of error ....!


can any one please help me whats the error with my server ?



yum install update
rpmdb: /var/lib/rpm/__db.001: No space left on device
error: db3 error(28) from dbenv->open: No space left on device
error: cannot open Packages index using db3 - No space left on device (28)
error: cannot open Packages database in /var/lib/rpm
CRITICAL:yum.main:

Error: rpmdb open failed



Filesystem 1K-blocks Used Available Use% Mounted on
/dev/sda5 20158332 817524 18316808 5% /
tmpfs 37102480 0 37102480 0% /dev/shm
/dev/sda1 495781 135563 334618 29% /boot
/dev/sda8 369841368 317160508 33891640 91% /home
/dev/sda2 40316280 5327204 32941076 14% /usr
/dev/sda3 40316280 29623968 8644312 78% /var
/dev/sda6 4233152 239448 3778664 6% /tmp


Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/sda5 1281120 18465 1262655 2% /
tmpfs 9275620 1 9275619 1% /dev/shm
/dev/sda1 128520 68 128452 1% /boot
/dev/sda8 23669952 1016007 22653945 5% /home
/dev/sda2 2564096 125021 2439075 5% /usr
/dev/sda3 2564096 2564096 0 100% /var
/dev/sda6 269280 1766 267514 1% /tmp

 

[cPanelMichael]

Hello

Is this a VPS? If so, have you check to make sure you have not reached any VPS resource limits imposed from the VPS hardware node?

Thank you.

 

[remshad]

no ,,,
Its dedicate server...

 

[cPanelMichael]

Assuming you have available space and inodes, it's possible the quota is not calculated correctly or there is hard drive corruption. Have you considered rebooting your system? It's not really recommended if you are not a qualified system administrator prepared to run FSK if necessary, but it may help to resolve the issue.

Thank you.

 

[quietFinn]

Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/sda5 1281120 18465 1262655 2% /
tmpfs 9275620 1 9275619 1% /dev/shm
/dev/sda1 128520 68 128452 1% /boot
/dev/sda8 23669952 1016007 22653945 5% /home
/dev/sda2 2564096 125021 2439075 5% /usr
/dev/sda3 2564096 2564096 0 100% /var
/dev/sda6 269280 1766 267514 1% /tmp

100% inodes used in /var

 

[remshad]

it seems /var inode is 100%

df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/sda5 1281120 18465 1262655 2% /
tmpfs 9275620 1 9275619 1% /dev/shm
/dev/sda1 128520 68 128452 1% /boot
/dev/sda8 23669952 1016010 22653942 5% /home
/dev/sda2 2564096 125026 2439070 5% /usr
/dev/sda3 2564096 2564096 0 100% /var
/dev/sda6 269280 30 269250 1% /tmp
[[email protected] var]#


whats FSK ? how to use with it ,,, we are on centos 6


how to solve my issue without affecting running website...

- - - Updated - - -

can i increase inode without affecting my server ?
if not ...
does deleting unwanted files saves inode ?

if yes..

where i can find unwanted files ...!


thank you for your great support

 

[cPanelMichael]

Restarting the system or running FSCK (File System Check) is not necessary. I read your initial inodes report as 10% instead of 100% (I was under the impression you posted the reports because no partitions were at 100%). This is the cause of your problem. You will need to reduce the number of files used in the /var partition. The following command should help you determine where most of the files are coming from:

for i in `find /var -type d `; do echo `ls -a $i | wc -l` $i; done | sort -n

Thank you.

 

[remshad]

thanks ..

i did a simple command to find most occurrences of small files

find /var -size 1k

- - - Updated - - -

rm -fr /var/spool/exim/input/*
rm -rf /var/spool/exim/msglog/*

saved my life ... now my system file stat is

[[email protected] ~]# df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/sda5 1281120 18465 1262655 2% /
tmpfs 9275620 1 9275619 1% /dev/shm
/dev/sda1 128520 68 128452 1% /boot
/dev/sda8 23669952 1016010 22653942 5% /home
/dev/sda2 2564096 124981 2439115 5% /usr
/dev/sda3 2564096 10818 2553278 1% /var
/dev/sda6 269280 79 269201 1% /tmp

df
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/sda5 20158332 817524 18316808 5% /
tmpfs 37102480 0 37102480 0% /dev/shm
/dev/sda1 495781 135563 334618 29% /boot
/dev/sda8 369841368 317166844 33885304 91% /home
/dev/sda2 40316280 5325228 32943052 14% /usr
/dev/sda3 40316280 15016208 23252072 40% /var
/dev/sda6 4233152 134516 3883596 4% /tmp

think ..
What did exim with us ?
exim created lacks of waste files ....

how can i resolve this issue permanently ...

 

[cPanelMichael]

That directory is associated with your mail queue. Rather than deleting those files, you may want to check next time to see if your mail queue is full. You can review the messages in the queue and see why they are not delivering.

Thank you.