Subscribe to our monthly newsletter to get the latest updates in your inbox
The digital advertising ecosystem is built on trust, working at its best when all participants are good, and when no one tries to deceive anyone else. That’s why ad fraud is potentially damaging – it can erode trust. Advertisers need assurance that their ads will be visible in the right places, and publishers want to be sure they aren’t losing revenue when fraudulent ads are sold in their name. But eradicating ad fraud is a collective effort and success will hinge on collaboration by all players in the industry. We’ve worked closely with TAG, the IAB, and other key players in the industry to tackle many of the issues around ad fraud, and we are committed to continuing and building on these efforts as the industry moves forward. At Google, we have a global team with more than 100 people dedicated to fighting ad fraud through a combination of engineering, operations, and policy. Our mission is to make the Google ecosystem safer for those who use it – including advertisers, agencies, and publishers who choose to use our platforms to support their digital marketing efforts – creating greater integrity and more transparency. We’ve worked hard to protect our ad systems, and we will continue to do so. This article highlights some of the key areas we’ve focused on in the past year, with the aim of showing some of the ways that Google is fighting ad fraud. We’re also sharing these insights to spur other players in the industry to take action against these threats.
1. We cut out injected ads. Unwanted ad injectors are rogue applications/software that insert new ads, or replace existing ones, into the pages that users visit while browsing the web (often showing ads that are not interesting or relevant to users). This harms advertisers, publishers, and users, while providing a bad user experience (we received over 300,000 user complaints about them in Chrome in 2015). We added to a growing number of ad traffic filters by extending protection for DoubleClick Bid Manager against injected ads using an automated data filter based on several blacklists produced by our operations team. Approximately 1.5% of the inventory across multiple exchanges is excluded as a result.
2. We shared data to help filter bot traffic. Created by automated bots and spiders, bot traffic is artificially generated traffic that originates in data centers (facilities that contain large computing and storage systems). We partnered with the Trustworthy Accountability Group (TAG) to produce a pilot program to share blacklists of data center IP addresses and domains associated with non-human ad requests or “bots,” (generated via automated data centre traffic). Back in May 2015 when the program launched, we found the blacklist filtered 8.9% of all clicks on DoubleClick Campaign Manager alone. Without filtering this invalid traffic from campaign metrics, advertiser click-through rates would have been inflated (vastly for some). This in turn would have had an impact on true campaign performance, and ultimately, return on investment for the advertiser.
3. We expanded our defenses against botnets. These are the huge families of infected computers that work together across the web in a coordinated dance aimed at generating massive amounts of invalid traffic by mimicking human behavior. Our team of engineers (or warrior scientists, as we sometimes like to call them) have been fighting ad fraud botnets and the malware that allows them to thrive for years. As with other defenses, we expanded protection of our ad systems by launching an innovative type of filter. This filter works by excluding traffic from three of the top ad fraud botnets (each comprised of more than 500,000 infected machines) and is also resistant to ongoing changes, aimed at making it hard to detect the malware that drives these botnets.
4. We boosted protection against falsely represented inventory. Ads showing up on illegitimate sites may be harmful for brands and are usually the result of falsely represented inventory (which occurs when the seller intentionally makes it look like their traffic is coming from another website). In some instances we’ve seen this type of activity account for up to 40% of inventory for a particular exchange purchased by DoubleClick Bid Manager. In addition to our ongoing operations work to exclude illegitimate and shady web sites, we launched a filter that extends this protection in an automated way, making it even harder for this type of abuse to occur, protecting brands’ and publishers’ best interests. Advertisers know their ads are being seen in the right places, whilst legitimate publishers aren't being cheated out of revenue from ads sold in their name.
5. We worked with others in the industry to forge a common language for our ecosystem. The industry needs to strive for precision when discussing these issues. With this in mind, it’s important to agree on a common language, which is why we’ve worked closely with the IAB TechLab and the Transparency Accountability Group (TAG) to create a taxonomy that organizes fraudulent traffic into five groups. Having clear labels about ad fraud means we can reduce confusion and communicate consistently.
6. We’ve collaborated with the industry on transparency. As an industry, we have a responsibility to promote transparency in the work that we do. At Google, we’ve been public about many of our projects in the fight against ad fraud, including putting into place policies to tackle hidden ads, injected inventory, and falsely represented inventory; processes to exclude automated data centre traffic; and robust defenses against botnets. We are also collaborating with key industry players on the new Payment ID system that makes it hard for fraudsters trying to cheat the system. We’re fully committed to improving ad traffic quality for players across the digital ecosystem, making the web a safer place for everyone. In light of the positive changes to come, we’ve asked two of our collaborators to share their outlook on combatting ad fraud in the coming year. Here are perspectives from publishers FT.com and buyer MediaMath.