I have an S3, and mine doesn't behave like that. Pressing the home button just minimises the navigation leaving the arrow in top right corner. Are you sure you haven't got an task manager app that is doing it?