Overview:
Amazon’s Outbound Communications team owned 17 automated push notification programs, with the intention of driving additional sales through product recommendations and reminders, powered by machine learning.
Our engineering team in India created the algorithms for the programs, as well as writing the customer-facing content.
The issue:
Due to the increasing consistency of negative customer feedback, culminating in an email from Jeff Bezos, there was a rush request to review and revise the algorithms, benchmarks, and content. The team paused these automated notifications, which represented a significant decrease in additional revenue.
My process:
As the only UX writer, I reprioritized my workload and joined with my partners in India in a rapid sprint process, working several early mornings and late evenings to expedite a solution.
I reviewed each program’s algorithmic strategy and its related copy to understand the disconnects, while also asking my engineering partners clarifying questions to ensure I understood their approach to each algorithm’s logic.
Next, I worked within the character limits of the push notification template to write copy that provided a clearer explanation of why the customer received the message. I also used a more neutral tone—even though engineering had tweaked some of the algorithms, I wanted to ensure the content could scale to whatever product might be shown.
Finally, I asynchronously shared the updates with senior leadership, using a table which showed the before and after, as well as the supporting algorithms. Once approved, I participated in final review and QA before implementation.
The entire review, revision, and relaunch of the programs took about a month, but my initial copy revisions were completed in five business days.
The result:
Because of the urgency to resume these campaigns, no copy testing was done. However, the relaunched programs, including revised content, had a 9% increase in click-through, a .08% decrease in opt-outs, and +55% increase in incremental sales.