I've checked further. The issue only occurs on one form that I can see and goes away if I uncheck the email column of data. This is a standard Bizform using a standard email capture field. Weird.
Obviously there's some funky data that has slipped through the Bizform validation.