Read-only filesystem

[salomonj]

Hey everyone, not sure this is the right place to post this, please let me know if it isn't this morning my server began having some trouble, I dont really know where to look, but Ive seen some threads that point me in the right direction;

root@mercury [~]# touch test
touch: cannot touch `test': Read-only file system
root@mercury [~]#

Does't matter where in the system I try, tmp, home, anywhere it gives me an error saying its a read-only file system.

The datacenter rebooted the server and ran fsck.

root@mercury [~]# smartctl -H /dev/sda
smartctl version 5.38 [i686-redhat-linux-gnu] Copyright (C) 2002-8 Bruce Allen
Home page is http://smartmontools.sourceforge.net/

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
Please note the following marginal Attributes:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   099   038   051    Pre-fail  Always   In_the_past 10148

root@mercury [~]#

I looked at this thread in particular as it is the same as my current problem; http://forums.cpanel.net/f5/read-onl...tem-23726.html

root@mercury [~]# /scripts/securetmp
Would you like to secure /tmp & /var/tmp at boot time? (y/n) y
Would you like to secure /tmp & /var/tmp now? (y/n) y
install: cannot remove `/etc/init.d/securetmp': Read-only file system
install: cannot remove `/etc/rc.d/init.d/securetmp': Read-only file system
Unable to update /etc/rc.d/rc.local
root@mercury [~]#

When I got to the above step I got stuck.

I also tried this; Zen Cart Support - View Single Post - Can't create/write to file '/tmp/ (Errcode: 30)

to no avail I get stuck here:

root@mercury [/var/log/httpd]# /bin/rm -fv /usr/tmpDSK
/bin/rm: cannot remove `/usr/tmpDSK': Read-only file system
root@mercury [/var/log/httpd]#

Also if any of this helps; Ive seen it on a few other threads;

root@mercury [~]# mount -l
/dev/sda3 on / type ext3 (rw,usrquota) [/]
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
/dev/sda1 on /boot type ext3 (rw) [/boot]
tmpfs on /dev/shm type tmpfs (rw)
none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
/usr/tmpDSK on /tmp type ext3 (rw,noexec,nosuid,loop=/dev/loop0)
/tmp on /var/tmp type none (rw,noexec,nosuid,bind)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)

mount: warning /etc/mtab is not writable (e.g. read-only filesystem).
       It's possible that information reported by mount(8) is not
       up to date. For actual information about system mount points
       check the /proc/mounts file.

root@mercury [~]# cat /etc/fstab
LABEL=/                 /                       ext3    defaults,usrquota        1 1
LABEL=/boot             /boot                   ext3    defaults        1 2
tmpfs                   /dev/shm                tmpfs   defaults        0 0
devpts                  /dev/pts                devpts  gid=5,mode=620  0 0
sysfs                   /sys                    sysfs   defaults        0 0
proc                    /proc                   proc    defaults        0 0
LABEL=SWAP-sda2         swap                    swap    defaults        0 0
/usr/tmpDSK             /tmp                    ext3    defaults,noauto        0 0
/tmp             /var/tmp                    ext3    defaults,bind,noauto        0 0

root@mercury [~]# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda3             899G  498G  355G  59% /
/dev/sda1              99M   49M   46M  52% /boot
tmpfs                 988M     0  988M   0% /dev/shm
/usr/tmpDSK           899G  498G  355G  59% /tmp
root@mercury [~]#

Can someone please help point me in the right direction? I am truly lost as to where to start. On the brighter side of things I do have a backup should this be a disaster.

[cPanelTristan]

You'd need to contact your datacenter or NOC again. If the system ran fsck and is still read-only mode afterward, then you'll need to have them check it over. If it isn't salvageable, you'd then need to ask them to setup a new server for you to use your backups.