The phrase "in all senses" is correct and is commonly used in written English. You can use it to refer to the multiple ways or meanings something can be interpreted or understood. For example: "This poem can be interpreted in all senses: literally, symbolically, and metaphorically.".
We must improve in all senses".
Everything is covered, in all senses.
In all senses of the term.
In all senses, a night to remember.
Wholesomeness is hot, in all senses.
It has become a city of excess, in all senses.
He was, in all senses, a student of human nature.
Ludwig does not simply clarify my doubts with English writing, it enlightens my writing with new possibilities
Simone Ivan Conte
Software Engineer at Adobe, UK