Each Google Chrome installation contains a unique ID that allows identifying its user. If you want to browse ‘anonymously’ with Chrome browser you need to remove this id.
Google doesn't make it an easy job to remove this ID. Here is a freeware tool called UnChrome which helps you with this task.
Download UnChrome from here.