mod userdir issue

[Zion Ahead]

I turned on mod_userdir protection, but then checkmarked to enable one particular user. However, it still shows 404 error. If I disable protection globally, it will work

I am using the proper method as well

www.domain.com/~username/

(or IP)

I even added this manually in the domain's virtualhost

<IfModule mod_userdir.c>
UserDir disabled
UserDir enabled username
</IfModule>

Then restarted apache, still doesn't work