"upon birth" is correct and usable in written English.
It is typically used to refer to the time when something starts or happens. For example, "Parents take on a huge responsibility upon birth of their child."
Requiring a man to sign verification of his knowledge of paternity upon birth seems backward.
Although Islamic law did not require manumission upon birth, the Qurʾān recommended it, and slave owners were often inclined to follow the religious tenet.
As ESPN's Rick Reilly so cleverly put it, the son of the legendary Paul Brown has had a career in football that "peaked upon birth".
The Arya Samaj opposes worship of murtis (images), animal sacrifice, shraddha (rituals on behalf of ancestors), basing caste upon birth rather than upon merit, untouchability, child marriage, pilgrimages, priestly craft, and temple offerings.
I worried that upon birth my child would not recognize my voice or that of my husband but only the gestational background noise she'd heard the most — the sound of a gavel slamming onto wood.
While the original handbook advised that "you should appear in print only three times in your life — upon birth, marriage, and death," today's prep is virtually screaming for some attention; the wasp mystique, it seems, has faded.
The male government minister announced that he would propose a small change in the law to allow women to have access to an abortion if the foetus suffered from such a severe deformity or condition that it could not survive outside the womb upon birth.
This study aimed to evaluate how far upon births the protection reaches, the effect of age at first birth, the interval between births in the whole population and the length of time from the first to the last birth and from the last birth to cancer among postmenopausal women.
What I have found in my 25 years in education is that as parents we are almost forced into this artificial race upon birthing our children.
Here we report profound effects of the earthquake upon birth-defect, birth weight and sex ratio at birth and other primary characteristics.
Previous studies of perinatal risk factors for childhood diabetes have relied upon births from earlier decades.
