Yeah... it changes it for the worse.
Now if they're lowered and using really stiff springs that make the ride suck already, its probably not a big deal because of the lower CG and stiffer springs preventing body roll. But for any other vehicle, just don't do it.
Front sway bar also does a lot more work than the rear sway bars, especially when cornering.