The state of the art for dynamic content acceleration relies on a “better than Internet” transport layer that ensures data can be transmitted from the microservice execution location to the end user’s device in predictable time. But given today’s solutions for dynamic content delivery, coupled with increased latency stemming from modern application chattiness and computation time, the result is usually slow application response time and a poor user experience.
Computing personalized experiences takes time, as does the delivery of requests and responses across the Internet. For example, if an application running on millions of mobile phones would ideally like to receive an origin update every second, the total time it takes to send the request to the origin, process a unique response, and send the response to the mobile phone must take well under 1 second. Since this is unlikely with today’s technology, the pragmatic answer is to send the update every 10 seconds. This reduces the origin’s overhead but negatively impacts the user experience. Thus, lacking the infrastructure and tools to deliver superior end user experiences has forced application owners to sacrifice application interactivity and dynamicity in favor of lower response times.