Your posts are all public and discoverable by web crawlers even if your instance didn’t federate at all. That’s kind of the point of activityPUB
ActivityPub does not have support for private messages. Services that try to shoehorn a direct message as “private” are misusing the protocol. You could configure client-side encryption but thats outside the scope of ActivityPub