This article originally appeared in Internet Retailer
As we head into the thick of the holiday shopping season, web teams must make sure the path from discovery to purchase is as easy and painless as possible. Knowing where potential fail points are ahead of time makes it easier to prepare, while real-time user data during the rush can help quickly spot problems.
In my house, the weather forecast always seems to be a topic of conversation. "What's the weather going to be like this week?" I'll ask my wife. But even with my eye on the forecast, when I wake up in the morning one of the first things I do is check the local temperature from my iPhone to help me choose what clothes I'll wear, and also mentally prepare for the chill. Even with the benefit of weather stations all over the map giving me the temperature data and expected precipitation, I still find myself opening up the front door and taking one step outside to see, how cold is it really and is it raining/snowing yet? You know you've done it too, when someone comes in from outside as you're deciding whether or not to grab a jacket and you ask, "hey, is it cold out?"
Monitoring web performance is very much the same. There are some cases where synthetic data, measured from test agents out on the Internet, is incredibly useful for setting a baseline for website performance. But to really understand the experience your users are seeing, web teams need to collect and analyze real-user performance data. Only data collected from actual site visitors and the devices they use will allow retailers to uncover the key patterns and actionable insights needed to keep website and application performance at optimal levels for a smooth visitor and buyer experience.
It's critical to understand if there is a gap between when your user thinks the application is ready and when they can actually interact with it.
For example, conversion rates may reveal that shoppers are abandoning the landing page for the deal of the week. But it is only with a granular real user data that the web team can figure out why--was there a micro-outage and what caused it?
As we head into the thick of the holiday shopping season, web teams will feel the pressure mounting to make sure the path from discovery to purchase is as easy and painless as possible. Lost sales due to poorly performing or unavailable sites are unacceptable in the cut-throat competition of the holiday season. As page load time goes from one second to five seconds, the probability of bounce increases by 90%. Fortunately, capturing real-user data in real time will help web teams detect when and where users are stumbling or falling down in the process and allow them to determine what to do to ensure they have a well-performing site.
Unpacking real user performance monitoring
The first thing to know is that real-user monitoring does not replace synthetic testing. Instead, it acts as a complementary process for different stages of the development and deployment cycle for retail web sites. Synthetic testing in browser is still important to help web teams make sure everything is working as intended, especially during the pre-deployment phases of development. Synthetic tests help set a baseline for performance optimization and can be useful in running experiments. Using multiple test agents for script tests that mimic what a user would see can reveal some very helpful points of optimization for the website.
However, these scripted tests are only as good as the test plan. Real users are much less predictable, and scripted tests are likely to miss conditions that will happen out in the real world.
Season-proofing with real-user data
With the insights from real-user data at hand, it is now time to put them to use. These insights can help web teams prepare for potential crises and make improvements that meet business goals when the stakes are high during the holiday rush.
It is also important for web teams to make sure they have a clear understanding of business priorities and KPIs and incorporate those into their strategy for optimization. For a retail site, that includes increasing conversions, reducing bounce and maximizing time on site.
According to Akamai's 2017 State of Online Retail Performance Report, data showed that conversion rate decreased drastically as page load time went up. For example, a 3-second load time cut mobile conversion in half from about 2 percent to 1 percent and continued to decline sharply from there as load times got longer. Being able to correlate those metrics to performance is valuable. Further than that, being able to monitor specific page elements and third-party objects and their impact on these KPIs gives you the power to prioritize the enhancements you need to make in preparation for and during the big rush.
As consumers start their holiday shopping earlier every year, or for those that race to the web at the last minute (me), retailers need to prepare with testing and experiments but also keep close watch by monitoring real-user performance during the holidays to give shoppers a seamless and satisfying user experience on any device, all the time.