"considering starting" is correct and usable in written English.
You could use it when you are thinking about beginning something, for example: "I am considering starting my own business."
D'Antoni said he was considering starting Robinson at point guard.
Low said before the game that he was considering starting Richter in Minnesota tonight.
Middleton is considering starting a program in New York, and she wanted to gauge local interest.
"Prove to the UK and people considering starting their businesses that everything is possible," he said.
The United States is considering starting talks that could lead to a bilateral free-trade deal.
Girardi said he was considering starting the season with Jeter as the designated hitter.
The company had already been considering starting international flights to neighboring countries like Mexico.
United Airlines said recently that it was considering starting a division that might provide corporate jet services like fractional ownership.
That same month, he told E. Stanley O'Neal, Merrill's chief executive, that he was considering starting his own hedge fund.
The success of the upcoming family reunion event would be key to Seoul considering starting up the tours again.
The league is now considering starting its own television network as part of a crucial new TV deal.
