<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><a name="_MailEndCompose"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Hey guys –
<o:p></o:p></span></a></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">My only concern is the short-sightedness of Email On Acid’s spam tester. EOA and Litmus both examine your email’s
<i>content </i>to make sure there aren’t any pieces of code or words that will trigger a spam filter. They are essentially using a criteria to examine the code of the email and make suggestions to help you not get got.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">ReturnPath’s inbox placement tests actually test the entire content of the email. They provide you with a seed list of about 100 emails, all from different domains
(yahoo, Comcast, AOL, Hotmail, Verizon, etc.). You then send a live email to the seed list, and RP will tell you whether the email was placed in the inbox or not, and will generally tell you why. This is a more effective way of testing because it takes into
account the entire email: IP address, authenticated domain of the sending address, info in the header of the email, subject line, and email content. This multidimensional approach will tell us not only if our content is bad, but if the system sending the email
is bad, too.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Let me know if you have any additional questions; happy to help!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:#0A81C4"><o:p> </o:p></span></b></p>
<p class="MsoNormal"><b><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:#0A81C4">Brent Walter<o:p></o:p></span></b></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black">Marketing Automation Strategist, DEG
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black">913.951.3112 (direct) |
</span><a href="mailto:BWalter@DEGdigital.com"><span style="font-size:9.0pt;font-family:"Arial",sans-serif">BWalter@DEGdigital.com</span></a><b><i><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:red"><o:p></o:p></span></i></b></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Benjamin Niolet [mailto:bniolet@mozilla.com]
<br>
<b>Sent:</b> Thursday, July 9, 2015 2:47 PM<br>
<b>To:</b> Ryan Kelly<br>
<b>Cc:</b> John Gruen; dev-fxacct; Christopher Karlof; Brent Walter<br>
<b>Subject:</b> Re: Let's set up a proper spam testing system<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">+Brent Walter from DEG<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Thanks for the question. For what it's worth, I use Email on Acid for inbox preview testing and like John, I'm paying out of pocket and getting reimbursed. Might be time for a better deal / license.
<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Email on Acid offers seed testing, which is the same type of service I mentioned to Ryan in Whistler. The basic gist of how it works is you send an email to a bunch of inboxes controlled by the testing service.
They are able to report on whether the message made it to the inbox (might have gone to spam or might have even just gotten lost in the mail. Strange but true).
<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I have never used Email on Acid for seed testing, but I suspect it's a lot cheaper than ReturnPath, the service I'm most familiar with. Since we already have an Email on Acid account in use, and from what I
can tell, seed testing is included, this seems like the right service to start with.
<o:p></o:p></p>
</div>
<p class="MsoNormal">Brent, any flags or blockers on using Email on Acid for seed testing the AWS confirm emails for accounts?
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><br clear="all">
<o:p></o:p></p>
<div>
<div>
<div>
<p class="MsoNormal">Ben Niolet | Email Marketing Manager<br>
Mozilla | <a href="mailto:bniolet@mozilla.com" target="_blank">bniolet@mozilla.com</a><o:p></o:p></p>
</div>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Thu, Jul 9, 2015 at 1:38 AM, Ryan Kelly <<a href="mailto:rfkelly@mozilla.com" target="_blank">rfkelly@mozilla.com</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal">On 9/07/2015 03:13, John Gruen wrote:<br>
> We should really be doing a better job of automating and testing spam<br>
> scores for FxA emails. One of the major factors determining email<br>
> spammy-ness is the overall reputation score of the email service<br>
> provider. This means that running spam tests from localhost will not<br>
> produce consistent, representative data.*<br>
><br>
> Thus far, we’ve been using Email on Acid to test our emails. In Email on<br>
> Acid world, a proper spam test would mean sending emails from our<br>
> production servers to a specific set of secret email addresses provided<br>
> through the EoA account. I’ve generally enjoyed using EoA, but maybe<br>
> there is better tooling out there. Either way, I think we should do a<br>
> better job establishing situational awareness about where our emails end<br>
> up. It’d be great if the whole thing were automated so that when we<br>
> deployed each new train, we automatically kicked off full email test.<br>
<br>
Sounds extremely worthwhile. I'm cc'ing Ben who may be able to comment<br>
on whether EoA is the best choice for automating this, or if we have<br>
existing agreements with a similar service. I recall him mentioning a<br>
similar-sounding service at Whistler.<br>
<br>
> Oh, also, it seems like we could buy a team license to EoA or Litmus and<br>
> I could stop paying for this stupid thing out of pocket. We are, after<br>
> all sending out a TON of emails. Thoughts?<br>
<br>
Yes, assuming with stay with EoA, we should definitely do this! LMK if<br>
you're paying out of pocket for any other services as well, and we'll<br>
make sure we get better arrangements in place.<br>
<br>
<br>
Cheers,<br>
<br>
Ryan<o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>