Yea, I am using extension-less URLs, and my application pool is set to Integrated.
In my trace log I get this message:
MODULE_SET_RESPONSE_ERROR_STATUS
ModuleName CMSApplicationModule
Notification MAP_REQUEST_HANDLER
HttpStatus 404
HttpReason Not Found
HttpSubStatus 0
ErrorCode The operation completed successfully. (0x0)