Locals noticed the body floating in the lake and alerted the police.
The Madhapur police, with the help of expert swimmers, retrieved the body and shifted it to the Osmania General Hospital morgue for preservation and identification.
A case has been booked and officials said efforts were on to identify the man.
Recent missing cases registered in local police stations were being verified.