"physical shortcomings" is correct and usable in written English.
You can use it to describe a physical limitation a person might have, for example: "Tommy had some physical shortcomings due to his congenital heart condition, but he still managed to live a full and happy life."
Even worse than the physical shortcomings, however, is the dearth of learning possibilities.
Despite some obvious physical shortcomings, Mr. Dafoe was unwavering in his certainty that he was right for the part.
There - despite inadequate earlier training and physical shortcomings that he would never wholly overcome - he showed iron certainty about the path he intended to follow.
Roland's depressing dismissal of Barbara lies within the bounds of that harsh streak discussed above, as does the way Taylor often dwells on her characters' physical shortcomings.
The only reason players with certain physical shortcomings don't get chances is because coaches and scouts have learned in the past that they couldn't win with those guys.
Greg's appraisal sends Steph into a tailspin that finds her delivering to his face a lengthy letter cataloguing in vivid detail his own physical shortcomings.
Then the scouting department looks for flaws — drunken-driving incidents, domestic violence issues, some kind of physical shortcoming.
Critics derided his phallocentrism, but Freudians could retort that they're overcompensating for psycho-physical shortcomings.
And James's physical and psychological shortcomings serve another purpose.
The track was written by Smith as a means to list his physical and artistic shortcomings.
Their 14-page assessment exposed a number of shortcomings, both physical and operational.
