It will help.  The problem is when you set the web.config key CMSUseAutomaticScheduler to true, it's not specified how "periodic" the page is requested. 
There is also a "Keep alive" webpart you can place on your master page which is highly configurable which will help as it requests a given page on a given interval.