Without tlsmgr, smtpd has no PRNG/entropy source and disables TLS, rejecting STARTTLS with "454 4.7.0 TLS not available due to local problem".