Server has disappeared... kind of.... maybe....

[schwim]

Hey there guys,

Got a notice today from a monitoring service that one of my servers was unreachable. I ran a traceroute and ping, and the domain was resolving to the proper IP, but I couldn't get to it via the browser. I tried another ISP and got the same result. I could get to another domain on this server.

As I worked on it, things began to change. First, I couldn't get to the second domain that I was trying. then, when rerunning the traceroute, I got "Lookup Failed. No IP address or host name with a valid lookup in input." as a response. Ping still comes back ok.

This has all happened in the span of 10 minutes. Shell doesn't work.

I'm not sure how to go about troubleshooting this. Usually, it's a work/don't work type of deal. I've never had it systematically shut down sites on the way towards the light

thanks,
json

 

[rpmws]

Hey there guys,

Got a notice today from a monitoring service that one of my servers was unreachable. I ran a traceroute and ping, and the domain was resolving to the proper IP, but I couldn't get to it via the browser. I tried another ISP and got the same result. I could get to another domain on this server.

As I worked on it, things began to change. First, I couldn't get to the second domain that I was trying. then, when rerunning the traceroute, I got "Lookup Failed. No IP address or host name with a valid lookup in input." as a response. Ping still comes back ok.

This has all happened in the span of 10 minutes. Shell doesn't work.

I'm not sure how to go about troubleshooting this. Usually, it's a work/don't work type of deal. I've never had it systematically shut down sites on the way towards the light

thanks,
json

sounds like a named issue where some sites have stale DNS zones good enough and others don't query for you. can you get to everything via IP address directly?

 

[c0mr4de]

If you can't, just get your Server host to reboot your server (Most probely a Crash)

 

[Lyttek]

Sounds vaguely similar to a problem I'm having...

http://forums.cpanel.net/showthread.php?t=73712

Are you able to shell using the IP?

 

[schwim]

Hi there guys,

sorry for my lack of response, as I was busier than a one armed paper hanger

I had the server rebooted, and it's running again. Once I got my email working, I found this:

Load report

Holy cow, look at the load average!

I have to say however, that I can't see the problematic process.

Does anyone see what I'm missing? And if so, is it just one of those things that happens sometimes, or do I need to look further into this?

Also, I couldn't get to it via IP or anything else, after the first few minutes. It was like an anvil.

thanks,
json

 

[nyjimbo]

Hi there guys,

sorry for my lack of response, as I was busier than a one armed paper hanger

I had the server rebooted, and it's running again. Once I got my email working, I found this:

Load report

Holy cow, look at the load average!

Is the load still high?. Can you get into WHM and see the apache status, thats a quick way to see whats getting hammered.

 

[schwim]

Hi there Jimbo,

No, it's looking pretty good right now:

Current Time: Thursday, 13-Dec-2007 09:30:28 EST
Restart Time: Wednesday, 12-Dec-2007 20:08:25 EST
Parent Server Generation: 0
Server uptime: 13 hours 22 minutes 3 seconds
Total accesses: 117620 - Total Traffic: 2.8 GB
CPU Usage: u21.34 s3.58 cu0 cs0 - .0518% CPU load
2.44 requests/sec - 61.8 kB/second - 25.3 kB/request
7 requests currently being processed, 51 idle servers

thanks,
json