I don't recommend a castle swap, but there's something the Asmo can do: get closer to the Elyos castle borders. However, they chase people away so aggressively that those without Xform leave without getting any GP, and those who don't get GP end up fighting in the first two castles; they don't even go to the third.
It's fine for me; I attack two castles in normal form and the third in xform form, and that's it. But for those without xform, it's torture.
They're not fighting within the castle walls; that's the biggest problem, or the administration needs to expand the border all the way to the obelisk.