Responsibility of button is form submission/processing, etc. I'd highly recommend using a link - it is designed to redirect.
What happens in your case: you click the button, which causes form submit. After this you perform redirect on the server side. When you click back browser remembers that form submission was the last action taken at that page, but it does not perform that form submit action by default, but asks your confirmation. This behavior might differ in different browsers.