You need to set IsLiveSite property of CMSHtmlEditor control to 'true':
<cms:CMSHtmlEditor ID="htmlTemplateBody" IsLiveSite="true" runat="server" ToolbarSet="Default">
</cms:CMSHtmlEditor>
Without this setting 'QuicklyInsertImage' button is displayed only if you are logged in.