"began to remove" is a correct and usable phrase in written English.
For example, you might write: "The surgery team began to remove the tumor with great care, ensuring minimal risk of complications."
Ms. Wallace began to remove her gold bracelet.
Slicing smoothly through the weasel's fur, she began to remove the pelt.
He next began to remove from churches and homes icons that he considered incorrectly rendered.
The operator of the Bryant Park carrousel began to remove overnight covers that protect the horses.
Seferi laid the scalpel aside and began to remove the clips that ran around the skull.
On their command, bulldozers began to remove barricades of tyres, paving stones and barbed wire.
Last autumn, work began to remove the 200-foot Elwha River dam in Washington state.
While Ms. Hoff's lobe was being sewn into Ms. Miles, doctors began to remove Ms. Gebhardt's.
With hardly a nod toward me, they began to remove their clothing.
When the waiter began to remove the extra setting, Mr. Frank stopped him.
Golborne could see that there was something wrapped around the drill bit, and he began to remove it.
