Server has disappeared... kind of.... maybe....

schwim

Well-Known Member
Aug 2, 2006
213
0
166
Hey there guys,

Got a notice today from a monitoring service that one of my servers was unreachable. I ran a traceroute and ping, and the domain was resolving to the proper IP, but I couldn't get to it via the browser. I tried another ISP and got the same result. I could get to another domain on this server.

As I worked on it, things began to change. First, I couldn't get to the second domain that I was trying. then, when rerunning the traceroute, I got "Lookup Failed. No IP address or host name with a valid lookup in input." as a response. Ping still comes back ok.

This has all happened in the span of 10 minutes. Shell doesn't work.

I'm not sure how to go about troubleshooting this. Usually, it's a work/don't work type of deal. I've never had it systematically shut down sites on the way towards the light :)

thanks,
json
 

rpmws

Well-Known Member
Aug 14, 2001
1,822
9
318
back woods of NC, USA
Hey there guys,

Got a notice today from a monitoring service that one of my servers was unreachable. I ran a traceroute and ping, and the domain was resolving to the proper IP, but I couldn't get to it via the browser. I tried another ISP and got the same result. I could get to another domain on this server.

As I worked on it, things began to change. First, I couldn't get to the second domain that I was trying. then, when rerunning the traceroute, I got "Lookup Failed. No IP address or host name with a valid lookup in input." as a response. Ping still comes back ok.

This has all happened in the span of 10 minutes. Shell doesn't work.

I'm not sure how to go about troubleshooting this. Usually, it's a work/don't work type of deal. I've never had it systematically shut down sites on the way towards the light :)

thanks,
json
sounds like a named issue where some sites have stale DNS zones good enough and others don't query for you. can you get to everything via IP address directly?
 

schwim

Well-Known Member
Aug 2, 2006
213
0
166
Hi there guys,

sorry for my lack of response, as I was busier than a one armed paper hanger :)

I had the server rebooted, and it's running again. Once I got my email working, I found this:

Load report

Holy cow, look at the load average!

I have to say however, that I can't see the problematic process.

Does anyone see what I'm missing? And if so, is it just one of those things that happens sometimes, or do I need to look further into this?

Also, I couldn't get to it via IP or anything else, after the first few minutes. It was like an anvil.

thanks,
json
 

nyjimbo

Well-Known Member
Jan 25, 2003
1,136
1
168
New York
Hi there guys,

sorry for my lack of response, as I was busier than a one armed paper hanger :)

I had the server rebooted, and it's running again. Once I got my email working, I found this:

Load report

Holy cow, look at the load average!

Is the load still high?. Can you get into WHM and see the apache status, thats a quick way to see whats getting hammered.
 

schwim

Well-Known Member
Aug 2, 2006
213
0
166
Hi there Jimbo,

No, it's looking pretty good right now:

Current Time: Thursday, 13-Dec-2007 09:30:28 EST
Restart Time: Wednesday, 12-Dec-2007 20:08:25 EST
Parent Server Generation: 0
Server uptime: 13 hours 22 minutes 3 seconds
Total accesses: 117620 - Total Traffic: 2.8 GB
CPU Usage: u21.34 s3.58 cu0 cs0 - .0518% CPU load
2.44 requests/sec - 61.8 kB/second - 25.3 kB/request
7 requests currently being processed, 51 idle servers
thanks,
json