nginx and robots.txt 404 error

[Speed Total]

Hi all,

I have installed the nginx inEasyApache and enabled for some domain, but now I am getting an error.

404 for robots.txt and if i rename the file in rrobots.txt (with 2 r or other name) the new file can be accessed.

Any ideas?

 

[cPRex]

Hey there! I'm not familiar with anything in nginx that would keep that file from being read normally. If you temporarily move/rename the .htaccess file as a test, does the file work properly?

 

[Speed Total]

tested with no htaccess, same situation.

 

[cPRex]

We did run into an issue last month where the favicon files were not being handled properly through nginx. If you are signed in to our ticket system you can see this article:

cPanel

support.cpanel.net

I'm wondering if something similar is happening here with the robots.txt files as well. Could you create a support ticket with our team so we can do some additional investigation on your machine?

 

[Speed Total]

ok. I have made an ticket. Will discuss this on the tickets.

 

[cPRex]

Can you post the ticket number here so I can follow along and make sure this thread gets updated?

 

[SGM]

I just bumped in the same issue. The problem is in /etc/nginx/conf.d/server-includes/cpanel-static-locations.conf file, which is included for every vhost. It's using specific location matches, so it never goes the default "location /" to proxy to apache, so it ends up looking for the files (both /favicon.ico and /robots.txt) in the default document root.

Quick and dirty fix - comment out the sections for both /favicon.ico and /robots.txt in /etc/nginx/conf.d/server-includes/cpanel-static-locations.conf.

 

[cPRex]

We have resolve this in the latest version, with some discussion on that here: In Progress - EA-9789 - NGINX Anacron Logrotate Error

 

[Benjamin Biswas]

We have resolve this in the latest version, with some discussion on that here: In Progress - EA-9789 - NGINX Anacron Logrotate Error

At which version you fixed the issue? I am using cPanel & WHM v102.0.11 & still getting same 404. I mean robots.txt not loading for any website & show 404 until omit the code as like my attachment from this file: /etc/nginx/conf.d/server-includes/cpanel-static-locations.conf

 

[cPRex]

Packages under EasyApache don't get assigned to a specific cPanel version as they are independent of the major release tier. Every package since ea-nginx-1.21.0-3.3.1 would have this fix applied. I checked my personal server just now and that is running ea-nginx-1.21.6-12.12.1

 

[alishy]

ok. I have made an ticket. Will discuss this on the tickets.

 

[cPRex]

@alishy - Can you post the ticket number here so I can follow along?