Anarchist Spectrum bigger than it seems?

I've noticed that the second I mention that I accept the free market, and most economic problems are created by state intervention in the free market, I get tossed into the An-Cap camps. But when I mention I am skeptical of Neo-Lockean property definitions, and speak of the inconsistencies of speaking of property, which is emergent, with absolute terms, I am now a commie. This will usually lead to the assumption that I am now a Mutualist, but I am still skeptical of the relationship between property and occupancy. In short I'm starting to think that anarchist are at risk of being placed into a non-pluralistic economic camps to the extent that the crucial core of anarchism, which is anti-authoritarianism is eroded. Anyone else experience this?