No Ivan, you're not alone.
I wouldn't exactly call myself a 'fan' either. Like a lot of people at the time I really enjoyed Numan's first four albums (TA/R/TPP and Telekon) and they all still rank very highly.
But after that ('Dance' etc...) I lost interest and there were other people doing more exciting things.
Didn't really raise an eyebrow until I was given a copy of Pure in 2005. I like that, and Exile too which I discovered post-Jagged.
I have a lot of respect for Numan's music and recognise its significance in the grand scheme of things, but it just doesn't inspire me like others do.
Luckily, he doesn't give a fig what I think.
Quite right too.