The speed difference you're talking about are going to be milliseconds, unnoticeable to the end user and won't make that big of an impact on SEO. There are other ways within Kentico to gain those milliseconds back. In fact, you can gain seconds back by performing other actions and still leaving your site under HTTPS. A few things to mention are:
- disabling viewstate
- specifying columns in queries
- use Kentico's minification engine
- fine tune Kentico's caching engine
- enable compression on the server
Plus you get the bonus of having your site secure and your viewers have that good feeling knowing they are secure.