By default Kentico should automatically create an alias for that page when you change the name. If not, check your site settings. Settings > URLs and SEO > Page URLs > Remember original URLs when moving pages. This property should be checked. Then Settings > URLs and SEO > SEO - URLs > Redirect page aliases to main URL should be checked.
Assuming those are correct, any link you have from a different location pointing to the old URL should take them to the new location.