Jasim Uddin Molla, Mirpur Division Additional Deputy Commissioner of Dhaka Metropolitan Police, said the withdrawn policemen are two sub-inspectors, an assistant sub-inspector and a constable.
The action was taken hours after the death of tea-seller Babul Matubbor.
Matubbor was rushed to the Intensive Care Unit (ICU) after he was brought to Dhaka Medical College Hospital at around 1:30 am on Thursday. He died there later.
The 45-year-old had suffered 90 percent burns.
Matubbor was attacked by policemen who demanded that he give them money, his family has said.
But police claimed he was a drug dealer and had caught fire while trying to flee from a police informer.