Yes. With a service that uses standard IMAP/POP3 protocols you can always download your entire mailbox and upload it somewhere else. If it's dependent of their apps and they don't provide full download as a feature, you're stuck.

Of course if you're the type that doesn't keep much email on the server it wouldn't affect you that much but then the whole encryption thing makes even less sense.