Net neutrality, explained

December 16, 2017

With the recent FCC action on net neutrality, a lot of people are worked up, but almost no one seems to know what it actually means. Here is what it is all about:

The Internet is a protocol for delivering small packets of data over a wide-area network. An important property of the internet protocol (for present purposes it is the most important property) is that packet delivery is best-effort. That means that internet routers will attempt to deliver every packet, but there are no promises. If a router gets overloaded, some packets will be dropped (i.e., not delivered).

The key question is this: when packets have to be dropped, how do you pick which ones? Historically, internet routers have generally chosen the packets to drop arbitrarily.

But for many applications, this is not actually what you want. For example, in streaming video (nearly 80% of all internet traffic) some frames are more important than others. Some frames are keyframes (which give the entire picture), while most frames only describe the differences from the previous frame. If you miss a regular frame, there is some degradation in the picture, but if you miss a keyframe, you have no picture until the next keyframe arrives. Consequently, it would be best if internet routers preferred keyframes to other frames. More generally, there is an area of research called quality of service, which seeks to enable applications that require a certain amount of reliable bandwidth, and typically does so by identifying and reserving network resources.

So what is network neutrality? Network neutrality is the principle that says that routers must not distinguish between packets when deciding which ones to drop.

As a technical matter, network neutrality would tie the hands of networking innovators by prohibiting any routing strategy that intelligently chooses which packets to favor. One can improve the network by adding more hardware, but not by using the hardware one already has more efficiently. (Note: some dispute this. I will return to this point later.)

So why do some people want network neutrality? There is concern about a certain sort of network management practice that ISPs might adopt. To explain this, it’s helpful to know a few statistics.

Over three-quarters of the internet traffic in North America is from video streaming. Netflix alone accounts for over a third of internet traffic. YouTube (owned by Google) accounts for another sixth. (Figures from December 2015.) This creates a tension between ISPs and content providers. The latter’s business strategy requires that they consume a brobdingnagian amount of network bandwidth, while the former are concerned that the content providers will overwhelm their networks.

Thus, the content providers are concerned that the ISPs will throttle back their content, or that the ISPs will demand that they help pay for it. And, in fact, on a few occasions, ISPs actually did something like this.

Back in 2007, when the concern was peer-to-peer file-sharing (mostly music and video), rather than video streaming, Comcast throttled back certain file-sharing protocols. On the face of it, one could argue it was reasonable, but, being Comcast, they did it in a super-sleazy way. Rather than announce they were doing it, they just did it secretly. People noticed, made a fuss, and Comcast stopped doing it. (Ironically, Comcast is now trying to position themselves as big supporters of network neutrality, while they literally did exactly the thing that net neutrality advocates are trying to prevent.)

Nevertheless, the Comcast incident is instructive, because it was corrected by the free market without any government intervention at all. The customers noticed, the customers complained, and Comcast stopped. Years later, AT&T blocked its customers from using Facetime on iPhones, and they too stopped after public outcry.

That’s the technical background. At this point it gets political. Google (which owns YouTube) made a big push for net neutrality, and it became a cause celebre on the left.

In 2010 the FCC announced its rules governing internet routing and they were quite bad for innovation. (You can find the relevant rules on pages 17944-17956 here, but the summary in the draft rules is much more accessible.) They were full of lip service about freedom to innovate, but they never defined the key terms of “nondiscrimination” and “reasonable network management.” (The final rules improved the draft rules by giving a non-circular definition of “reasonable network management,” but they defined it (¶82) in terms of “legitimate network management purposes” which they did not define.) They specifically say (¶83) that “reasonable network management” will be evaluated on a case-by-case basis. Consequently, if you want to stay out of trouble, you have to go to the FCC for permission to do anything.

At this point, there is one more important element. The FCC actually had no legal authority to regulate the internet, and when they tried to do it anyway, they lost in court. But, never ones to allow something like that to stop them, the Obama administration reclassified the internet from an information service (which they have no power to regulate) to a telecommunications service (which they do).

A telecommunications service is a service that transmits information without change in its form or content. An information service is a service for generating, acquiring, storing, transforming, processing, retrieving, utilizing, or making available information via telecommunications. (Via Ars Technica.) The sticky thing is the internet is pretty clearly both of these. Some applications are more like an information service: the web, search engines, social media, video streaming, file sharing, cloud drives; while other applications are more like telecommunications: email, instant messaging, voice over IP, online gaming, remote login. Certainly the vast majority of traffic is in the first category, but a case can be made for either.

It is harder to make a case to reclassify the internet as telecommunications service when it is already classified as an information service, particularly since most internet usage is moving in the opposite direction. But, when the matter went to the Court of Appeals, only one of the three judges was bothered by that. The other two applied the Chevron principle which requires that judges defer to administrative agencies unless their decisions are clearly wrong. (It’s a terrible principle, but that’s another topic entirely.) As it happens, the 2-1 decision was Democratic appointees versus a Republican appointee, which emphasizes how political the matter has become.

Anyway, the reclassification allowed the FCC to regulate the internet (or, more precisely, home access to the internet). Another effect was to erase all of the FTC’s internet privacy rules. Instead, FCC crafted its own rules, but the FCC is not an agency with experience with consumer privacy protection, so the result was, as the FTC put it, “not optimal.” Moreover, there were other pernicious effects that had not fully played out yet.

At this point, net neutrality has become a proxy battle between progressives and conservatives. Conservatives oppose net neutrality because they generally oppose regulation, but especially because they don’t want to set the precedent that the government can regulate the internet. Net neutrality may be well-intentioned (if ill-conceived), but they worry that net neutrality will be just the beginning. Hillary Clinton’s statement that net neutrality is “a foot in the door” plays into that concern.

Now the FCC has re-reclassified the internet as an information service again, as it was until 2015. This makes the FCC’s net neutrality regulation null and void. So what happens now? In the near term, nothing at all. The internet survived without net neutrality until 2015, with very few abuses and nearly all of those quickly corrected by the free market. If an ISP ever tried to block an internet content provider that didn’t pay the ISP (a standard scenario in net neutrality’s parade of potential horribles), they would immediately face the wrath of their consumers, and have to reverse themselves. They know it, so they won’t even try.

In the longer term, it’s hard to say. The business model of Netflix and others, who soak up most of the internet’s bandwidth without paying anything for the infrastructure that makes it possible, may turn out to be unsustainable. If so, something will have to change. The same would have been true with net neutrality. But this is a technical problem, and the repeal of net neutrality means that networking researchers can develop a technical solution. Were net neutrality in play, technical solutions would be banned, so the solution would have to be political. That would mean that rent-seeking, not innovation, would be the future of the internet, and we would all be the worse for it.

UPDATE: Added the AT&T-Facetime affair to the preceding discussion.

ANOTHER UPDATE: The discussion above focuses on policies for choosing packets to drop, but there’s another aspect of network neutrality that I left out: concern that ISPs might block certain services entirely. This too happened once: a small phone company blocked voice over IP in an effort to force customers to pay for phone service. This case runs against my general thesis, because it was the (Bush-era) FCC, not the market, that put a stop to it. (Oddly, the FCC was able to do it at a time when it had no regulatory authority over ISPs at all, which says something about the intimidation powers of federal regulators.) Nevertheless, this is a baldly anti-competitive practice and I think the FTC has the power to address it under existing antitrust rules.

(Previous post.)


A brief history of recent US involvement in Iraq

December 16, 2017

We are just short of the 11th anniversary of President Bush announcing the surge. Iraq long ago faded from the headlines, but it’s been an eventful year, culminating last month with Iraq reclaiming its last piece of ISIS-held territory. It seems like a good time to look back at how the Islamists in Iraq were defeated, re-constituted, and re-defeated:

  • January 2007: President Bush announces surge.
  • January 2007: Barack Obama opposes surge, says it will make matters worse.
  • June 2007: Insurgent attacks peak at 1800 per week.
  • September 2007: General Petraeus reports to Congress that the surge is working. Democrats accuse him of lying.
  • October 2008: Insurgent attacks fall below 400 per week.
  • January 2009: President Obama takes office.
  • November 2009: Insurgent attacks fall below 200 per week.
  • February 2010: Obama administration claims credit for Iraq.
  • December 2011: President Obama withdraws all US troops from Iraq, having made no attempt to negotiate a new status of forces agreement.
  • August 2013: President Obama refuses to act on Iraqi requests for air strikes against ISIS.
  • January 2014: President Obama likens ISIS to a “J.V. team.”
  • May 2014: First ISIS attack outside the Middle East.
  • June 2014: ISIS takes Mosul.
  • June 2014: President Obama sends US troops back into Iraq.
  • October 2014: The New York Times reports on thousands of Saddam-era chemical weapons found in Iraq. Bizarrely, it accuses the Bush administration of covering them up.
  • October 2014: First ISIS attack in the United States injures 3.
  • June 2016: Orlando nightclub attack kills 49.
  • July 2016: Nice truck attack kills 86.
  • August 2016: Obama again fails to bomb ISIS convoy.
  • January 2017: President Trump takes office.
  • May 2017: Secretary Mattis announces new strategy and rules of engagement.
  • July 2017: ISIS defeated in Mosul.
  • October 2017: ISIS defeated in Raqqa, its supposed capital.
  • November 2017: Iraq reclaims its last ISIS-occupied territory.

UPDATE: This is timely.