As a s/s nuker hybrid, i would say the opposite - stay on protectors. at least until you move to ROC where almost all the mobs have mag attack.
Yes, garment has some benefits. But i've tried grinding with garms and prot - and with prot i feel better, i die harder and i feel stronger when i PvP/job ecc.
For a nuker, i can resist more dmg in a fight, and i already have a high mag deff, so i don't need the garms so badly.
Ofcourse, that's my own opinion, i will be switching to garments too, only because soon, when i am full farmed i will make a lot of taxies for my friends. But i will keep my prot set because i prefer it for grinding and jobbing.
That's what i can say from my 86 lvl expirince in the game

Also, see that topic, it's about INT hybrids, but Razorhead says somethings about the prot/garms that could be useful for u
viewtopic.php?f=29&t=99772