Initially tonight I was planning to write a bit about the need to improve email services in terms of scalability, redundancy, and performance given today's demanding environment and increasing email volume. As I was thinking about how to approach such a topic, it became clear to me after a moment of cat inspired meditation, that this was a pretty broad topic to try to cover in one post. (In case you were wondering, cat inspired meditation can happen when the cat has wandered across one's power strip button. At this time, one may find herself on her hands and knees, under the desk, thinking about life and small fur hats.)
So I started thinking about email volume. After returning from under the desk, I ran across many websites predicting that email volume will only be increasing more in the next few years. Every day more and more businesses depend on email communication. More and more people receive electronic billing statements, use email based support, get email confirmations for online purchases, and so on. However, what really struck me was how many websites are predicting that beyond this, a big problem in the future of email will have to do with increasing attachment sizes.
More and more people and businesses want to use email to send each other videos, large presentations, PDF manuals, software demos, and so on. Some websites predict that soon people may well expect to be able to send 200MB attachments, or possibly larger, via email. I have started to see this more and more lately myself. At @Mail, we regularly have requests from customers for ways to tune the system so that they can send larger attachments than the default of 16MB. Also, many of the companies that I have consulted for have requested large attachment support.
This is a huge nightmare from an administrative point of view for many reasons. Here are just a few, but the list goes on and on (really, I could rant about this for hours.)
- Email is really not designed to be effective as a large file transportation system. It was not built for this, and no one who writes SMTP servers is interested in changing this, for many good reasons.
- Sending a large attachment, especially to a lot of people, generates a huge amount of load on an internal network.
- Often, a mail server will time-out before an attachment of a very large size can be sent, either at the sending, or at the receiving end.
- Most mail servers out there have limits to attachment sizes for incoming messages, so even if you allow and tune your systems so that users can send large attachments, the mail may be rejected.
- The sender may inconvenience a receiving party who is on a limited speed connection trying to download their email, especially if that person is paying on a per bandwidth basis.
- If the mail server accepts really large attachments, it becomes massively vulnerable to DOS attacks.
Despite all of this, many businesses still really want to have some way to email around large files, and do not want to bother with setting up an FTP site, or some other sort of secure file sharing tool. You can explain to people why this is a bad idea until you are blue in the face, but it does not change the fact that from a user-friendly point of view, people would really like the process of sending a file to be as simple as putting it in an email message.
A few companies are now starting to provide appliance solutions that sound like a nice way to strike a compromise that will keep end users happy, and avoid all of the problems of sending huge email attachments. These appliances essentially grab large attachments from emails after the user has sent them, and replace them with a secure download link, so that the email going out is just a link that the receiver can click on to download the attachment. All this happens transparently to the sending users, and makes it really easy for everyone involved. Accellion and Intradyn are examples of companies selling such appliances, but I am sure there are others.
I did some more searching, but so far have not found any open source software solutions that someone could put to use to accomplish this task yet. It would not be that difficult of a thing to do with a SMTP proxy and some exciting plugins, or possibly even with a simple script that messages get sent to when they are over the attachment limit set in the MTA.
Hopefully I will have the time to look into this further myself, as I think this would be a great solution for many of my clients. And if anyone reading has already done this, it would be great to hear from you.
My cat and I would be very grateful.
Leah
There are no comments for this entry.
[Add Comment]