Chats that are started when private mode is enabled should not be saved. That is essentially the entire point of private mode. Like a web browser not saving browsing history when using private browsing.

At the very least, there should be an option to prevent chats from saving.

Chats not saving in private mode is actually how the site used to work but recently (within the last few months) this regressed.