nginx and robots.txt 404 error

[Speed Total]

Hi all,

I have installed the nginx inEasyApache and enabled for some domain, but now I am getting an error.

404 for robots.txt and if i rename the file in rrobots.txt (with 2 r or other name) the new file can be accessed.

Any ideas?

 

[cPRex]

Hey there! I'm not familiar with anything in nginx that would keep that file from being read normally. If you temporarily move/rename the .htaccess file as a test, does the file work properly?

 

[Speed Total]

tested with no htaccess, same situation.

 

[cPRex]

We did run into an issue last month where the favicon files were not being handled properly through nginx. If you are signed in to our ticket system you can see this article:

cPanel

support.cpanel.net

I'm wondering if something similar is happening here with the robots.txt files as well. Could you create a support ticket with our team so we can do some additional investigation on your machine?

 

[Speed Total]

ok. I have made an ticket. Will discuss this on the tickets.

 

[cPRex]

Can you post the ticket number here so I can follow along and make sure this thread gets updated?

 

[SGM]

I just bumped in the same issue. The problem is in /etc/nginx/conf.d/server-includes/cpanel-static-locations.conf file, which is included for every vhost. It's using specific location matches, so it never goes the default "location /" to proxy to apache, so it ends up looking for the files (both /favicon.ico and /robots.txt) in the default document root.

Quick and dirty fix - comment out the sections for both /favicon.ico and /robots.txt in /etc/nginx/conf.d/server-includes/cpanel-static-locations.conf.

 

[cPRex]

We have resolve this in the latest version, with some discussion on that here: In Progress - EA-9789 - NGINX Anacron Logrotate Error