Hi Stuart
When you assign the same template to multiple pages, this template is consider reusable, so any template level component change will affect all pages using this template. So that's the correct behavior.
Now the add/remove web parts, where are you adding/removing them? In Visual studio or in CMS under DESIGN tab?