I have contract Kentico Support. If we are using cloud front as CDN, it's really easy.
In WebConfig file. make sure the EndPoint set to https
<appSettings>
<add key="CMSAmazonPublicAccess" value="true" />
<add key="CMSAmazonEndPoint" value="https://yourcdn.url" />
</appSettings>