[Exim] Exim TLS

I got Exim TLS working on RedHat Linux. Works great so far. One question
though. Is there a way to use a private key file with a password on it?
I saw no option for providing the password and exim fails with this
error when there is a password on the key:

(SSL_CTX_use_PrivateKey_file): error:0906406D:PEM
routines:DEF_CALLBACK:problems getting password


Perhaps exim should ask for the password when it starts up? Kind of like
the way mod_ssl/apache do it?