If you do not tell others your boundaries, they will not be able to respect them. Therefore, it is your responsibility to set, communicate, and enforce your limitations. You can do so in a way that is loving and clear. No one needs to be aggressive about it.