To add to this issue, I had IPN working in sandbox and the above mentioned issue only occurs when not using sandbox.
This leads me to believe it's an issue with my settings in Paypal but does visiting the URL <url>?paypalListener=paypal_standard_IPN involve those PayPal settings because that fails too?