I think what might be part of the issue is, we're trying to set this up https://docs.xperience.io/configuring-xperience/scheduling-tasks/installing-the-scheduler-windows-service because emails are getting stuck in the queue when no one is using the admin.
We turned off that scheduled service that we set up and it seems to have stopped the errors.