The Challenges of Server Side Ad Insertion and Why They’re Worth It

Today it’s more important than ever that broadcasters and publishers are able to deliver and monetize content across every device type. It’s equally important that these content providers meet the expectations of their audiences – a linear TV experience. This is where server side ad insertion (SSAI) has a compelling value proposition and there’s an interest in understanding how it works.

Server side ad insertion (SSAI), also referred to as dynamic ad insertion (DAI) or ad stitching, is the process of combining content and ads into a single stream of video before delivering it to the player. This eliminates buffering and circumvents ad blocking. Without SSAI, ads are inserted client-side (CSAI) using logic within a player or SDK to call an ad server like Doubleclick, SpotX or AppNexus etc. SSAI eliminates that call so ad blockers are unable to detect and block third-party domains. Eliminating that call also eliminates buffering and delays between the content and the ads, creating a smooth, linear TV-like experience.

SSAI systems work in one of two ways, manifest manipulation and ad-creative ingest. The more common method is manifest manipulation, which involves writing out a manifest, or playlist, for the stream that includes video stream segments from different sources – the content source and the ad service. In this model the content service makes the ad request, parses the response from the ad server, and then writes out the stream manifest to include segments from the content service and directly from the ad service.

This approach has the advantage of being simpler to implement and is quicker to do, however the stream segments from the various sources can be encoded slightly differently, and these differences can trip up the decoder on some devices. These services try to make up for differences by inserting what is called a discontinuity – a marker to indicate the decoder should be reset. But some players only take this to mean the timeline should be reset, not all the encoding parameters. For example the content video may have a different set of audio tracks from the ad creative, or it may have a different key frame interval. These differences sometimes lead to the player not knowing how to proceed and interrupting playback.

The other approach, ad-creative ingest, has the content service make the ad request, parse the response, and then actually download and process, or ingest, the linear video creative. By ingesting the ad creative just as it would any other video content, the SSAI service can control the quality of the output. In particular it can do things such as normalize the audio – so the ad doesn’t seem much louder than the content – as well as make sure the whole video – content and ads – has the same encoding parameters throughout – for maximum compatibility with players and devices. This method even has the ability to work with devices that do not support discontinuities.

The SSAI stream delivery service makes the ad request on behalf of the client in either case. One common concern is that the ad service needs to know the request is not fraudulent. Since all requests come from the same IP address range, and frequently from those assigned to well-known public clouds, these requests can be hard to distinguish. One way to handle this is for the SSAI service to pass the client context to the ad service, specifically the device user agent and requesting IP address.

The exact way this is done currently varies between services, but for instance, Brightcove uses HTTP headers borrowed from HTTP proxy services — X-Forwarded-For and X-Device-User-Agent. The more heavyweight IAB AdCom spec, governing how ad requests are trafficked by OpenRTB services, is an alternative way to send client context.

The applications for SSAI span far beyond better user experience and defeating ad blockers. Since SSAI ads are “stitched” into the content, they play out just like any other portion of the video and do not require special player or device logic, and therefore they work everywhere that streaming video works. It allows broadcasters and publishers to monetize across all device types, notably the consoles and TVs that are driving the growth in OTT viewing but that may not have client-side hooks to request and handle ads and analytics.

At Brightcove, the expansion of connected living room viewing among their customers’ audiences has been a driver of growth in their usage of SSAI. Brightcove shared data with me that shows that the customer base which has adopted SSAI has increased usage by 75% over the course of the last six months which you can interpret to be a positive signal of its efficacy. Sometimes Brightcove suggests a hybrid ad delivery (SSAI + CSAI) approach that looks like this:

Although web-based ad delivery methods are absent in these environments, advertisers’ expectation to deliver on web-based ad metrics still persists, which presents the first challenge of SSAI. The current generation of OTT video and connected TV applications have evolved from web video; videos that play in a web page. The video ad stack that has grown up for web video is largely based on how display ads work (non-video image-based ads for web sites). A non-video website typically contains a mixture of text, images, and interactive content. All of these elements are loaded by the web browser, sometimes from different servers, and rendered together. Certain web browser technologies, specifically browser cookies and the ability to execute JavaScript, have become essential to how ads are loaded and rendered in the page. These elements make it possible to do things like ad targeting (and retargeting) and executing proprietary verification scripts that are downloaded with the ad units called VPAID scripts.

Targeting users is still possible without cookies using device IFAs (identifiers for advertisers), unique identifiers and even IP addresses. In a post-GDPR world, where cooking users becomes very difficult or perhaps impossible, these new identifiers may even be the future of audience targeting. However, without these legacy web browser capabilities, one thing that reigns true is that VPAID is non-existent in these app-based environments. This has been the main objection of SSAI, as traditional web video advertisers are not able to buy off of the VPAID metrics they’re familiar with, including viewability.

Ensuring that ads are seen is important, however it should be less of a concern for these premium, non-web environments. There’s less risk of user abandonment – toggling between browsers or channel surfing. The video is also less likely to compete for screen real estate with the player taking up most, if not all, of the screen. There’s also much greater trust between buyers and sellers for this inventory type, and the majority of transactions on this premium inventory take place in private marketplaces. Being able to serve ads on this premium inventory and ensure they’re being delivered by mitigating ad blockers should alleviate the concerns of any skeptical advertiser.

Why It’s Worth It. The ability to reach OTT connected devices and avoid ad blockers far outweighs the manageable challenges of targeting and measurement, the impact of which continues to be reduced. SSAI improves user experience, protects revenue and expands reach through an easy and proven integration path. Broadcasters, publishers, and advertisers alike have come to expect digital targeting and measurement with a linear TV experience and SSAI is filling that need and will continue to be iterated upon to address any remaining gaps.

Sponsored by

Announcing The EdgeNext Summit, Oct. 15th: From CDN and WAF to DDoS and DNS, Learn What’s Next at the Edge

I’m very pleased to announce that in conjunction with my Streaming Summit at the NAB Show New York, we are also launching a new event called the EdgeNext Summit. Taking place Monday Oct 15th, the event will focus on content distribution at the edge and all that is taking place with CDN, WAF, DDoS, DNS & more. While CDN will be one of the applications the event focuses on, this isn’t just another “CDN” show, but rather a “what’s next for the edge” event, showcasing all the new decentralized ways services are being brought closer to the eyeballs.

The one-day Summit will be produced by me and promoted and marketed along with the NAB Show in New York and will take place at the beautiful Convene space near Grand Central. Platinum sponsors for the event already include AWS Elemental, CenturyLink, Ericsson, Fastly, Google, KingSoft, Limelight Networks, Rafay, StackPath, Verizon Digital Media Services and others to come.

With two tracks, and nearly 50 speakers, the EdgeNext Summit will feature a combination of technical use cases, case study presentations and fireside chats, of like-minded professionals with similar challenges and goals. If you’re a Chief Architect; Director of Digital Ops & Distribution; Senior Software Engineer, Manager of Web Development, Content and Distribution Manager, or involved with Network Operations & Infrastructure, you’ll want to come to the EdgeNext Summit.

Our goal is to make this event affordable to everyone, so you can register online using the discount code edge18 and attend the event for only $495.

Like you, I’m excited for what the future holds with new edge services and use cases and this is your chance to help shape the discussion and education around what’s next for the edge. I welcome your ideas and thoughts at any time.

OTT Execs From NBC, DISH, AT&T, Google, Comcast, Sony, Fubo TV & Cheddar, Highlight Streaming Summit Program

I’m excited to announce that I will be doing ten fireside chats with executives from Sling TV, PlayStation Vue, DirecTV Now, Comcast, Google, Facebook, Cheddar, NBC Sports and Fubo TV – at my Streaming Summit, part of the NAB Show NY, taking place Oct 17/18.

The entire program is now live at www.nabstreamingsummit.com and we’ll have nearly 40 sessions and 125 speakers. You can register with a special discount for $595 at this link

We’ve got nearly 40 sessions and 125 speakers talking about the bundling of content, ad strategies, video codecs, webcasting production, sports streaming, SAAI, blockchain, direct to consumer, AV1 benchmarking, CMAF, SRT, and more! Check out the program and contact me if you haven’t yet sent in a speaking request.

We Need More Graphics In Live Video Streams To Enhance The User Experience

Data driven overlay graphics are ubiquitous in live television. The elements that are known in the broadcast world as lower thirds, over-the-shoulders, tickers and bugs have been sharing screen space with live video on sports and news broadcasts for well over 20 years. While some content creators and publishers have managed to integrate a few of these graphical overlays into their streaming-only productions, the results have been lackluster at best.

A poor imitation of broadcast with limited options, inferior production value and none of the interactivity and personalization that mobile or web viewers were promised years ago. More commonly, live OTT content from major publishers is simply the same television broadcast production but delivered to a different screen. To generalize, live OTT productions can be grouped into two categories when it comes to overlay graphics. Small, digital-only content that is created specifically for OTT delivery and broadcast television productions which simulcast certain content to digital platforms. In the former, you generally have few if any graphic overlays and the production value is subpar. In the latter, the viewer gets the exact same graphics which are burned into the video feed during production – the same experience as the television viewer. Less than ideal in either case.

But why aren’t unique overlay graphics more common in live streaming productions? A little history first. Data-driven animations have always been costly and complex to do well in a live broadcast environment. Companies like Vizrt, Chryon Hego and Ross (XPression) provide powerful graphics systems that are used to create many of the animating information graphics you’re accustomed to seeing in broadcast. From Super Bowls and CNN to local news affiliates, most of these productions are powered by traditional broadcast graphics systems. While robust and reliable – in other words perfect for live television production – these systems are also expensive, require on-prem hardware/software and have a steep learning curve. In other words, inappropriate for many streaming productions. Ultimately, live OTT productions demand distinct graphic production tools, not systems that were created for broadcast.

Strangely, with the continual advancements in streaming video quality, comparatively little has changed in the web video production space – at least in terms of overlay graphics. OTT viewers either get the same graphics as the television feed (which are frequently too small to read on their tablet, desktop or mobile device) or they get no graphics at all. Where is the interactivity, customization and personalization that the web already makes possible?

The good news is that low latency streaming has enabled new HTML overlay tools that not only give web video productions a similar feature set to traditional live broadcast productions, but even surpass them in terms of enhanced monetization possibilities. The same live overlay elements that you see on television are now available to web-based video productions but unlike broadcast, these elements can be interactive and personalized. HTML platforms like Singular.live allow content creators to add dynamic, client side overlays that compliment their live video by enhancing production value, engaging viewers and ultimately keep them watching longer. And because these native web overlay platforms don’t require custom hardware, software or specialized expertise to operate, the costs are minimal.

With client side HTML rendering, there are more monetization opportunities as viewers watch longer, are more engaged and can be targeted with specific information. A win win, and potentially a big point of differentiation between traditional linear television and video content delivered via the web.

Hosting Dinner With Fastly For Wall Street Investors, July 25th in NYC

On Wednesday July 25th at 6pm, in association with JNK Securities, I will be hosting a dinner in NYC for Wall Street investors with Fastly’s President (Joshua Bixby), Head of Strategic Partnerships (Lee Chen), and Fastly’s CFO (Adriel Lares). Hot on the heels of another big round of funding for Fastly, the company has spent the past seven years disrupting the CDN market, focusing on performance, security and media delivery.

We plan on discussing the changes in the competitive landscape with the need for platform services at the edge and the advent of serverless and edge compute trends. Attendees will learn about the innovative approach Fastly has taken with their network architecture and how it is disrupting the market in functionality, performance and underlying cost structure. We will also discuss the factors (i.e., scale, price, features, ease-of-deployment) that customers use to evaluate their CDN vendor and discuss some of the latest pricing, product and customer use cases for edge compute.

If you are interested in attending the dinner, please reach out to me but note that this dinner is only for those on Wall Street and space is limited.

Hosting Dinner For Wall Street Investors With StackPath, July 19th in NYC

On Thursday July 19th at 6pm, in association with JNK Securities, I will be hosting a dinner in NYC for Wall Street investors with Lance Crosby, StackPath’s Chairman and CEO. Lance previously founded what is considered to be one of the first cloud platforms, SoftLayer, which he sold to IBM for $2 billion in 2013. Attendees will hear how StackPath delivers enterprise-grade security and performance in a frictionless, on-demand platform with cloud-scale control and flexibility. We will discuss the latest needs by customers to protect, accelerate, and innovate for CDN, WAF, and Managed DNS, along with the latest trends in automation and virtualization capabilities.

If you are interested in attending the dinner, please reach out to me but note that this dinner is only for those on Wall Street and space is limited.

ISPs In Africa Say Netflix and Other OTT Services Are Taxing Local ISPs, Threatening To Derail Broadband Investments

The thorny issue of international content providers like Netflix selling online VOD subscriptions services in South Africa/Africa, whilst simultaneously not paying a cent of their revenue to South African Revenue Services in the form of company tax, has been reported from a number of different perspectives. In the case of Netflix, at 300,000 paying subscribers in South Africa at roughly $10 per month, it amounts to a lot of corporate tax avoidance. But to be fair to Netflix, right now the way the law is written, Netflix isn’t legally required to pay the tax.

Yet a different issue with much more severe impact, conveniently ignored until recently, is the issue of how OTT content players who generate vast amounts of local traffic, contribute to the expansion of the local network infrastructures, in Africa/South Africa. ISP networks are expected to carry large volumes of traffic, at peak times, without any congestion, latency, or buffering to end-users binge watching Game of Thrones in HD.

In recent conversations with a few ISPs in Africa, they are hugely reluctant to continue to put in place the capacity that is needed, when they have to pay all the costs to do so. Historically, Netflix has argued that they shouldn’t have to pay ISP’s to deliver its video content because consumers are already paying for Internet access. In addition, their dominance and huge appeal to VOD customers gives them massive leverage to force ISP’s into submission to host their hardware, or the ISPs risk losing disgruntled broadband consumers.

The harsh reality is that especially in Africa, ISP’s are being squeezed even more by consumers who are demanding lower broadband pricing, whilst expecting their access circuits to go faster and faster, whilst they consume more and more video at higher and higher quality. ISPs say something has to give and have commented that it is threatening the growth of broadband investments as a result. It has been well reported that Netflix has grudgingly entered into paid peering agreements with networks like AT&T, Verizon and Comcast in the U.S., but in Africa, it’s a different story.

When Netflix entered the market in 2016, they were not entertaining any paid peering negotiations but rather focussed on settlement-free peering and deploying their Open Connect servers in local networks. Generally, some ISPs were ok to receive the Netflix servers just to ensure that they could deliver on their subscribers’ content experience, and ISP’s also saved on the lowered usage of expensive international bandwidth as Netflix servers were now in the country, serving the local demand.

However, fast forward two years to 2018, and this “squatting model”, as some ISPs refer to it, is now completely broken, thanks to the exponential demand of video and arrival of many other content giants who are finding their new homes in locations like Teraco data centres. When ISP’s in Africa factor in the likes of Google, Netflix, DSTV Box Office, Showmax, DSTV Now, AWS, and Azure, all who have the expectation to put traffic on the networks and expect everything to keep working, without contributing to the economic effect, it’s not a model for success.

Teraco data centres have become the preferred hosting location for many local and international companies, due to their network neutral placement, which all the ISP’s have a fiber connection to. The previous hosting model of placing servers within an ISP’s data centre building created a situation whereby it was very difficult, if not impossible, to move away from an ISP who became unreliable or uncompetitive, thereby creating the perfect opportunity for Teraco to prosper locally.

Ironically, most ISP’s have built up substantial local hosting portfolios over the past 10 years, and traffic delivery fees have always been a component of the monthly bill. The economics at the time were well understood. However, whether company servers are placed in ISP’s data centres or Teraco’s data centres, traffic still flows in much the same way to end users, and must be charged for. Most ISP’s whose hosting business is migrating to Teraco, face catastrophic revenue loss, and no means to fund the exponential traffic growth emanating from these data centres.

Local ISP’s in Africa tell me they simply can’t keep the pipes open without these content giants contributing pro-rata to the financial effect they have on upgrading these networks to deliver their content at the quality they expect. For them, ISPs say the free ride has to come to an end, especially in markets like Africa where broadband infrastructure is not mature or pervasive, and enormous build-outs are still required to connect millions of households, who want a high-quality VOD experience.

Some ISP’s have calculated that the local IP transit cost attributable to Netflix alone for delivering their content to a subscriber in South Africa, is roughly $0.40 cents per month, which is less than 5% of Netflix’s monthly $10 fee. ISPs argue that’s not a lot when you consider Netflix is taking out roughly $3M per month from the local South African economy and putting nothing back.

If Amazon AWS, Microsoft Azure and Google with their cloud platforms are successful in luring enterprise South Africa away from local ISP’s and onto their locally hosted cloud platforms, and traffic from the Teraco data centres continues to get a free ride, ISPs in Africa say it’s game over for everyone in the ISP value chain. Of course this debate is nothing new and we’ve seen Netflix and ISPs argue for years over who should pay for the network improvements that are needed to deliver all of the video that is going over the last-mile. But when ISPs say they are getting wary of continuing to invest, in a country like Africa where broadband still needs a lot of development, it’s bad news for all companies involved in the video ecosystem.