TLDR; Only public keys are going to be stored on IPFS, no other user data.