'carried with him' is a grammatically correct and usable phrase in written English.
For example, you could say "He always carried the memories of his hometown with him wherever he went."
He had a creative eye that he carried with him through life and in his degree.
Sargent still carried with him the values of the academic tradition in which he was trained.
A doctor carried with him two things: a bottle of whiskey and a knife.
It is as if he carried with him the unease of his country and his class.
He was frail, yes, but carried with him a blazing intelligence and cheerful serenity.
He certainly carried with him, to Oxford and beyond, more than a hint of class resentment.
But along with his guitar, Ediberto Ayala carried with him an irrepressible sadness.
He was happy taking notes on file cards that he carried with him.
He carried with him the proof copy of his unpublished erotic poem "Christabel".
He carried with him a book on Zen meditation called Peace Is Every Step.
Throughout his career, Clottey carried with him the spirit from the neighborhood.
