Anytime you change a setting, you need to flush your cache. Because of the fact you're using a caching plugin. Each cache plugin should have there own reset/flush button to do just that. Take a look at the settings.
So I would go to permalinks and click on save TWICE. Then go to your caching plugin and do a reset.