What version of Kentico are you using? Portal engine or MVC? I assume that by turning off you mean unpublishing. In this case, the page is not accessible so you need to create e.g. IIS URL rewriting rules or request event handler and redirect the requests to unpublished pages wherever you want. I do not know what widgets you mean, but you can probably add a condition into the widget configuration or code to not to list items with the redirection set (DocumentMenuRedirectUrl not null or empty) or add an extra field to the page type which will be used as a flag "show in widgets" and use this field in the widget configuration/code.