International email
International email arises from the combined provision of internationalized domain names (IDN)[1] and email address internationalization (EAI)[2]. The result is email that contains international characters (characters which do not exist in the ASCII character set), encoded as UTF-8, in the email header and in supporting mail transfer protocols. The most significant aspect of this is the allowance of email addresses (also known as email identities) in most of the world's writing systems, at both interface and transport levels.
Email addresses
Traditional email addresses are limited to characters from the English alphabet and a few other special characters.[3]
The following are valid traditional email addresses:
Abc@example.com (English, ASCII) Abc.123@example.com (English, ASCII) user+mailbox/department=shipping@example.com (English, ASCII) !#$%&'*+-/=?^_`.{|}~@example.com (English, ASCII) "Abc@def"@example.com (English, ASCII) "Fred Bloggs"@example.com (English, ASCII) "Joe.\\Blow"@example.com (English, ASCII)
A Russian might wish to use иван.сергеев@пример.рф as their identifier but be forced to use a transcription such as ivan.sergeev@example.ru or even some other completely unrelated identifier instead. The same is clearly true of Chinese, Japanese and many other nationalities that do not use Latin scripts, but also applies to users from non-English-speaking European countries whose desired addresses might contain diacritics (e.g. André or Płużyna). As a result, email users are forced to identify themselves using non-native scripts - or programmers of email systems must compensate for this by converting identifiers from their native scripts to ASCII scripts and back again at the user interface layer.
International email, by contrast, uses Unicode characters encoded as UTF-8 - allowing for the encoding the text of addresses in most of the world's writing systems.[4]
The following are all valid international email addresses:
用户@例子.广告 (Chinese, Unicode) अजय@डाटा.भारत (Hindi, Unicode) квіточка@пошта.укр (Ukrainian, Unicode) θσερ@εχαμπλε.ψομ (Greek, Unicode) Dörte@Sörensen.example.com (German, Unicode) коля@пример.рф (Russian, Unicode)
UTF-8 headers
Although the traditional format for email header section allows non-ASCII characters to be included in the value portion of some of the header fields using MIME-encoded words (e.g. in display names or in a Subject header field), MIME-encoding must not be used to encode other information in a header, such as an email address, or header fields like Message-ID or Received. Moreover, the MIME-encoding requires extra processing of the header to convert the data to and from its MIME-encoded word representation, and harms readability of a header section.
The 2012 standards RFC 6532 and RFC 6531 allow the inclusion of Unicode characters in a header content using UTF-8 encoding, and their transmission via SMTP - but in practice support is only slowly rolling out.[5]
Interoperability via downgrading
Domain internationalization works by downgrading. UTF-8 parts, known as U-Labels, are transformed into A-Labels via an ad-hoc method called IDNA. For example, Sörensen.example.com
is encoded as xn--srensen-90a.example.com
. In 2003, when the need was addressed, that seemed easier than checking that all DNS software could comply with UTF-8 strings, although in theory DNS can transport binary data. This encoding is needed before issuing DNS queries.
Note that domain names are also, if not primarily, used for web navigation. EAI differs.
Since traditional email standards constrain all email header values to ASCII only characters, it is possible that the presence of UTF-8 characters in email headers decreases the stability and reliability of transporting such email. This is because some email servers do not support these characters. Checking compliance with UTF-8 strings must be done software package by software package (see #Adoption below.) There was an experimental method proposed by the IETF, by which email could be somehow downgraded into the legacy all-ASCII format which all standard email servers support.[2][6] This proposal was too cumbersome, because the meaning of the left hand side part of an email address is local to the target server. No way to check that xn--something
isn't a valid user name, used in some domain. So that experiment has been obsoleted in 2012 by RFC 6530.
Standards framework
The set of Internet RFC documents RFC 6530, RFC 6531, RFC 6532, and RFC 6533, all of them published in February 2012, define mechanisms and protocol extensions needed to fully support internationalized email addresses. These changes include an SMTP extension and extension of email header syntax to accommodate UTF-8 data. The document set also includes discussion of key assumptions and issues in deploying fully internationalized email.
Adoption
- 2013-11-14: The Bat! Email Client implemented support for Internationalized Domain Names (IDN) in email addresses.[7]
- 2014-07-15: Postfix mailer started supporting[8] Internationalized Email, also known as EAI or SMTPUTF8, defined in RFC 6530 .. RFC 6533. Initial support was made available with a development version 20140715, and on 2015-02-08 ended up in a stable release 3.0.0.[9] This supports UTF-8 in SMTP or LMTP sender addresses, recipient addresses, and message header values.
- 2014-07-19: XgenPlus Email Server started supporting [10] IDN based[11] email, also known as support for SMTPUTF8 , specially for .भारत domain.
- 2014-08-05: Google announced[12] that Gmail will recognize addresses that contain accented or non-Latin characters, with more support for internationalization to follow. Their mailers (MX MTA) are announcing support for SMTP Extension for Internationalized Email (SMTPUTF8, RFC 6531).
- 2014-09-30: Message Systems announced[13] that their product Momentum (versions 4.1 and 3.6.5) provides SMTPUTF8 support, the email address internationalization extension to the SMTP protocol, allowing emails to be sent to new, non-western addressed recipients.
- 2014-10-22: the version 2.10.0 of Amavis mail content filter was released[14] which added support for SMTPUTF8, EAI, and IDN.
- 2016-12-07: почта.рус Launches fully Russian (Cyrillic) email in Moscow through a press conference.[15][16]
- Chief Minister Vasundhara Raje of Rajasthan launched one Free Email address @rajasthan.in and @राजस्थान.भारत domain on 3 December 2017. Rajasthan state became the World's first state to provide email address to every citizen in their own language.
- 2016-10-18: Data Xgen Technologies launched a free linguistic email address under the name "DATAMAIL". In support of Digital India this made in India email app supports IDN (internationalized domain name) in Hindi (हिन्दी), Gujarati (ગુજરાતી), Urdu (اردو), Punjabi (ਪੰਜਾਬੀ ਦੇ), Tamil (தமிழ்), Telgu (తెలుగు), Bangali (বাংলা), Marathi (मराठी), Latin English. DATAMAIL has launched international languages for the countries using Arabic (العَرَبِيَّة), Russian (русский)and Chinese (汉语/漢語) as their base language.[17][18]
- 2017-03-07: Apple store includes product to support EAI.[19]
- 2017-12-27: Microsoft announces coming IDN email support on Office 365[20] and also announces partner XgenPlus hosting IDN mailboxes.[21]
- 2018-01-03: Microsoft Adds E-Mail Internationalization to Exchange Online.[22]
- 2018-09-18: Courier-MTA releases support for Unicode E-mail messages, in UTF-8, for all Courier packages. In addition, Courier-IMAP uses Unicode (UTF8) for names of maildir folders.[23]
See also
References
- Started with: Paul Hoffman; Marc Blanchet (7 March 2003). Nameprep: A Stringprep Profile for Internationalized Domain Names (IDN). doi:10.17487/RFC3491. RFC 3491.
- Started with: John C Klensin; YangWoo Ko (7 February 2007). Overview and Framework for Internationalized Email. doi:10.17487/RFC4952. RFC 4952.
- RFC 5322: Internet Message Format
- RFC 6530: Overview and Framework for Internationalized Email
- Mackie, Kurt (2 January 2018). "Exchange Online Getting E-Mail Internationalization Support". Redmond magazine. Retrieved 1 November 2018.
- Jiankang YAO; Wei MAO (8 July 2008). SMTP Extension for Internationalized Email Addresses. doi:10.17487/RFC5336. RFC 5336.
- "The Bat! 6.0 with Unicode and IDN support: The Bat! speaks many languages". 2013-11-14.
- Postfix SMTPUTF8 support (unicode email addresses)
- Postfix stable release 3.0.0
- "Government to Offer Free .bharat Domain Name With .in Purchase". Retrieved 2016-08-13.
- "IDN Email supported by XgenPlus email server". xgenplus.com. Retrieved 2016-08-13.
- A first step toward more global email
- Message Systems Introduces Latest Version Of Momentum With New API-Driven Capabilities
- Amavis 2.10.0 released
- http://www.comnews.ru/content/105068/2016-12-08/pochtarus-hochet-izbavitsya-ot-prepyatstviy
- https://cctld.ru/en/news/news_detail.php?ID=11042
- "Data Xgen Technologies launches email address in Indian languages". Deccan Chronicle. 2016-10-18. Retrieved 2016-10-22.
- "DataMail: World's first free linguistic email service supports eight India languages - The Economic Times". The Economic Times. Retrieved 2016-10-22.
- "EAI Mail". apple.com. 7 March 2017.
- "EAI support announcement". The Microsoft Exchange Team Blog. Retrieved 9 November 2018.
- Holl, Don; er. "Microsoft announcement of EAI in India". Universal Acceptance Steering Group (UASG). Retrieved 2019-07-06.
- Kurt Mackie (3 January 2018). "Microsoft Adds E-Mail Internationalization to Exchange Online". MCPmag.
- Sam Varshavchik (18 September 2018). "New releases of Courier packages". courier-announce (Mailing list). Retrieved 5 July 2019.