I had forgotten about this term/label that I read about on Medium, I think, a couple of years ago. It did resonate with me. I am a bit more towards the physical attraction side of this spectrum as I do notice the hotties, yet as I wrote about myself back in 2013:

"Anyone reading this already knows from conversation that casual sex bores me. What I mean is it doesn’t hold my attention for multiple repeat encounters and at this point in my life I don’t now seek it out. Sure, if an opportunity presents itself… Sure it’s physically satisfying — “Sex without love is a meaningless experience, but as meaningless experiences go, it’s pretty damn good.” (Woody Allen). “It’s wonderful fun. Why, it’s just about the most fun you can have with your body, if you’re talking of strictly physical experiences alone.” (From Conversations with God — Book 1). Perhaps because I am not driven by sex, but by connection, is also why I am capable of platonic love of a woman. It seems that most people do not believe that such can exist because they are not capable of it. For me, the choice between no relationship because for whatever one or many reasons romance is not in the cards, or having that person in my life and deriving shared spiritual pleasure from each other’s non-romantic intimacy and company and connection, is a no-brainer in favor of the latter."

I am not saying that I never desired those woman sexually. At times that did develop. But if it wasnt' in the cards I didn't act upon it.

Like you I both get and don't get why it's on the asexual spectrum. Putting aside that all labels are ridiculously constraining, I can view sexuality as being depicted by a two axes graph. Lets say the x axis has fully physical attraction at one pole and zero physical attraction at another. Let's say the y axis has only attracted to other sex at one pole and only attracted to same sex at the other end. Then through a series of questions one could plot themselves somewhere in the 4 quadrents of the image.

Then similar but also not similar to demisexual there is sapiosexual...