I figured it out. I forgot I had Purist's Vanilla Patch installed which was causing these issues. I noticed the mod was altering some faction stuff according to the console information. Disabling the mod has so far made the Forsworn hostile again. Haven't encountered any vampire thralls yet but I assume that is fixed as well.
Sorry again for neglecting to mention I had extra mods enabled and thanks for helping.