Considering a resently found out glitch this should actually be possible. As the mod only adds skins and no other items or similar it should be able to be played with others that do not have the mode installed. For them they would see another skin. Either one of the default ones, or if other skin mods are installed propably one of those.
If you can join them even while they dont have the fatify mod then they wont see the fatified models