You are correct and that's why it's a shame that the authors of Roe and the other privacy rights decisions chose that weak foundation rather than building on the bedrock of the first amendment's provision prohibiting the establishment of religion. I wrote a more detailed comment directly to AP which has a link to my essay that I wrote back in December