Nearly two years ago, we published the blog post "Clarifying State of the Internet Report Metrics," which served as a great reference for those interested in finding out more about the metrics published within the State of the Internet Report. Since the report has evolved, we're releasing an update to clarify existing metrics and review new ones, with the goal of minimizing confusion about terms and data in the report.
As we have discussed in the past, there are several sources of broadband speed data, including measurements collected by the United States Federal Communications Commission (Measuring Broadband America), Ookla (SpeedTest/NetIndex),SamKnows, Netflix and others. As these and Akamai's measurements all make use of different methodologies, sample sizes and user populations, they are each measuring slightly different things, though they may use similar terminology. To that end, there is not necessarily any one right or wrong set of data - each is correct, considering the associated biases of the measurements.
The measurements published in the quarterly State of the Internet Report are taken from requests made to Akamai's HTTP/S platform. (During a quarter, we analyze between 100-200 trillion content requests from more than 200 countries/regions around the world.) To be completely clear, none of the data in the report comes from Akamai's native streaming networks (Adobe Flash, Apple QuickTime and Microsoft Windows Media). As such, any third-party assertions that the connection speed measurements published in the report are skewed lower by rate-limited streaming are incorrect.
Within the report, data is aggregated and presented at country/region and U.S. state levels - the geolocation of each unique IP address is identified with Akamai's EdgeScape solution. This data encompasses connections from both residential and business connections, and as such, represents a blend of the observed connection speeds. (It is important to note that the report has never claimed to measure only residential traffic.) Having said that, we believe that the number of residential connections to Akamai's platform greatly outnumbers the number of business connections, so the potential skew caused by higher speed business connections should be minimized. In addition, as noted within the report, we endeavor to remove connections from known mobile networks from the underlying data set, so as to mitigate the potential skew caused by slower mobile connections. (Although as mobile providers and subscribers shift to 4G LTE, mobile connection speeds are rapidly increasing.)
Below we look at each of the individual connectivity metrics featured within the report in more detail:
- Average Connection Speed:This metric is calculated by taking an average of all of the connection speeds calculated during the quarter from the unique IP addresses determined to be in a specific country/region or U.S. state. (IPv4 addresses unless otherwise noted.) There are a number of factors that can influence the average connection speed measurement:
- Smaller files: The connections used to download smaller files (relative to larger software downloads and media files) may be short-lived enough that they do not reach maximum throughput rates. Think of it as being similar to driving on multiple short trips around your neighborhood on local roads versus going on a multi-state road trip on the highway.
- IP address sharing: In this increasingly hyperconnected world, a single user may have multiple Internet-connected devices, and an average household today certainly does: from smartphones, tablets, televisions and gaming systems to thermostats and other connected devices. If multiple devices behind a single Internet connection (a unique IP address) are all consuming content simultaneously, each device will ultimately have access to only a fraction of the whole connection, ultimately lowering the overall speed calculated for each request to Akamai. (Obviously, this is also true on a much larger scale for business connections, where requests from hundreds of users may appear to be coming from a single gateway IP address.)
- Average Peak Connection Speed:To calculate this metric, an average is taken of only the highest connection speed calculated from each unique IP address determined to be in a specific country/region or U.S. state. In the report we note that we believe that the average peak connection speed is more representative of Internet connection capacity. By using the fastest measurement observed from each unique IP address, we are capturing only those connections that reached maximum throughput rates. Often, though not always, these connections are associated with the downloading of larger files, such as desktop applications, games and software updates. While these measurements are closer to the theoretical maximum capacity of the user's Internet connection, they are unlikely to be representative of true throughput during normal usage conditions. Furthermore, presenting an average will also mitigate the impact of the extremes - while there may be users connecting at Gigabit speeds in a country, there will also be users connecting at dial-up, satellite and DSL speeds.
- High Broadband Connectivity: This metric represents the percentage of unique IP addresses making connections to Akamai from a given country/region or U.S. state with an average connection speed of 10 Mbps or more. In order to qualify for inclusion in the global rankings within the quarterly report, more than 25,000 unique IP addresses from a given country/region needed to have average connection speeds above 10 Mbps in that quarter.
- Broadband Connectivity: This metric represents the percentage of unique IP addresses making connections to Akamai from a given country/region or U.S. state with an average connection speed of 4 Mbps or more. In order to qualify for inclusion in the global rankings within the quarterly report, more than 25,000 unique IP addresses from a given country/region needed to have average connection speeds above 4 Mbps in that quarter.
- 4K Readiness: This metric represents the percentage of unique IP addresses making connections to Akamai from a given country/region or U.S. state with an average connection speed of 15 Mbps or above. There is some debate as to the amount of bandwidth required for 4K adaptive bitrate streams, but many estimates fall somewhere between 10-20 Mbps, depending on the codec used. Given that, we felt that choosing a 15 Mbps threshold would provide the best insight into the percentage of unique IP addresses connecting to Akamai from within a given country or U.S. state that are most likely to be able to sustain such streams within this range. Note that there is not a 1:1 equivalence between unique IP addresses and end users or broadband subscribers, so leveraging this statistic to claim that "X% of end users/broadband subscribers can consume 4K video" is technically inaccurate. (Multiple users can share a single IP address, which is especially true of home broadband subscribers. In addition, a broadband subscriber may be assigned multiple unique IP addresses over the course of a single quarter.) In order to qualify for inclusion in the global rankings within the quarterly report, more than 25,000 unique IP addresses from a given country/region needed to have average connection speeds above 15 Mbps in that quarter.
- Mobile:We include data on average and average peak connection speeds, as well as broadband connectivity, for connections from IP addresses determined to be on mobile networks, aggregated at a country/region level. Starting with the First Quarter, 2014 State of the Internet Report, we shifted from using a manually maintained list of autonomous systems (AS) where we believed that the entire AS was used for mobile traffic, to a system informed by mobile device identification data. In the new system, Akamai identifies device characteristics at the edge of the network, and if a certain percentage of devices used to connect from a given network block are known to be mobile devices, then that network block is designated as mobile. However, this change resulted in a significant increase in the number of networks classified as mobile, to the point where it would have been unwieldy to include within the report, so we decided to aggregate the data at a country level, as is done in other sections of the report. In order to qualify for inclusion in the global rankings within the quarterly report, more than 25,000 unique IP addresses from a given country/region needed to make requests to Akamai from mobile networks during the quarter.
Ultimately, the speed an end user sees at any given point in time on either a fixed (fiber, cable, DSL, dial-up) or mobile connection will likely be somewhere between the average and average peak connection speeds but could be a bit faster or slower, depending on multiple factors.
While Akamai does not publish data within the report at a network level, our network partners can check metrics for their Autonomous Systems on the Akamai Network Partner Portal. If you're looking for data about a specific country that's not featured in either the global section or one of the regional sections of the report, check the Appendix, because it contains metrics for a larger set of countries. In addition, we also suggest that you check the two State of the Internet data visualizations available on the State of the Internet website - one displays metric values from the current quarter's report using a map-based interface, while the other enables users to graph historical values of key report metrics for the top 100 countries and all U.S. states. Beyond that, if you are interested in data that you can't find in the report, or if you have a question about something published in the report, please reach out to us via e-mail, via Twitter (@akamai_soti) or on theAkamai Community State of the Internet Subspace.