Well it depends on your build.
Don't reject something because it may be associated with a caste that isn't typically pro-manosphere. Wear what looks good. The fit is ALWAYS the most important thing with clothes.
Ray-bans are associated with pretentious Indie bands from New York. It doesn't bother me, I wear them every day because they are the ones that give the look that will drop women's panties the most frequently (I wear fake ones though as it's a matter of shape not brand).
It works both ways too. Don't just pop into an Armani store and spend $2000 on a suit because it's Armani and that's what Bradley Cooper wears. A $2000 suit that doesn't fit is a crap suit. A $200 concoction that does fit is a better suit.
Forget brands, forget castes and don't reject anything because of societal implications (And just as equally, don't just buy something for the purpose of breaking them like a hipster does)
Run around boutique stores for 8 hours and iteratively find the best look for yourself. If you're not satisfied, go back and do it again for day two until you're happy. This is how YOU look and how you present yourself. You should be picky and demanding, this is important.
Does it fit? Does the material make the garment sag too much? Does the material make the garment look cheap? Is it too garish? Is the colour tone correct for my hair colour? Will it match my belt? Is it making my figure look masculine? Is the piece appropriate for the setting (Asia and America will have big differences in what decides an attractive look).
It's a decision which depends on the person.
But, I'll add my opinion:
If you're big, open your buttons up and flap the collars out, it'll accentuate your wide abdomen and will look very Alpha. (Tbh, big guys get a lot of lee-way with clothes you could wear a white t-shirt out and get a lot of IOI's where a skinny man would look ridiculous.)
If you're skinny though, a button-down collar is an absolute must if you want to achieve a masculine shape.
I'm skinny, and the way I spot a dorky skinny guy in a club is by how much he opens his collar.
You want no attention drawn to your skinny abdomen. If you open your top buttons up and let the collars flap out you'll draw attention to your xylophone ribs.
The result is a Harry-Hill-like affect where your head is tiny and you look like you're trying out for amateur Tango lessons. All you need is a rose and you're there:
If you're skinny, keep your abdomen compact, it'll make your neck look wider and your jaw look more streamlined: