Internet and Cyberlaw

Missing the Data for the Algorithm

A short new paper by Steven T. Piantadosi of the University of Rochester has some interesting implications for the types of behavioral modeling that currently drives so much of the technology in the news these days, from targeted advertising to social media manipulations to artificial intelligence. The paper, entitled “One parameter is always enough,” shows that a single, alarmingly simple function–involving only sin and exponentiation on a single parameter–can be used to fit any data scatterplot. The function, if you’re interested, is:

Screen Shot 2018-05-30 at 3.27.27 PM

Dr. Piantadosi illustrates the point with humor by finding the value of the parameter (θ) in his equation for scatterplots of an elephant silhouette and the signature of Joan Miró:

Screen Shot 2018-05-30 at 3.20.23 PM

The implications of this result for our big-data-churning, AI-hunting society are complex. For those involved in creating algorithmic models based on statistical analysis of complex datasets, the paper counsels humility and even skepticism in the hunt for the most parsimonious and elegant solutions: “There can be no guarantees about the performance of [the identified function] in extrapolation, despite its good fit. Thus, … even a single parameter can overfit the data, and therefore it is not always preferable to use a model with fewer parameters.” (p. 4) Or, as Alex Tabarrok puts it: “Occam’s Razor is wrong.” That is, simplicity is not necessarily a virtue of algorithmic models of complex systems: “models with fewer parameters are not necessarily preferable even if they fit the data as well or better than models with more parameters.”

For non-human modelers–that is, for “machine learning” projects that hope to make machines smarter by feeding them more and more data–the paper offers us good reason to think that human intervention is likely to remain extremely important, both in interpreting the data and in constructing the learning exercise itself. As Professor Piantadosi puts it: “great care must be taken in machine learning efforts to discover equations from data since some simple models can fit any data set arbitrarily well.” (p. 1), and AI designers must continue to supply “constraints on scientific theories that are enforced independently from the measured data set, with a focus on careful a priori consideration of the class of models that should be compared.” (p. 5) Or, as Kevin Drum puts it: “A human mathematician is unlikely to be fooled by this, but a machine-learning algorithm could easily decide that the best fit for a bunch of data is an equation like the one above. After all, it works, doesn’t it?”

For my part, I’ll only add that this paper is just a small additional point in support of those lawyers, policymakers, and scholars–such as Brett Frischmann, Frank Pasquale, and my soon-to-be colleague Kate Klonick–who warn that the increased automation and digitization of our lives deserves some pushback from human beings and our democratic institutions.  These scholars have argued forcefully for greater transparency and accountability of the model-makers, both to the individuals who are at once the data inputs and, increasingly the behavioral outputs of those models, and to the institutions by which we construct the meaning of our lives and build plans to put those meanings into practice. If those meanings are–as I’ve argued–socially constructed, social processes–human beings consciously and intentionally forming, maintaining, and renewing connections–will remain an essential part of making sense of an increasingly complex and quantified world.

 

What If All Proof is Social Proof?

In 1931 Kurt Gödel proved that any consistent symbolic language system rich enough to express the principles of arithmetic would include statements that can be neither proven nor disproven within the system. A necessary implication is that in such systems, there are infinitely many true statements that cannot (within that system) be proven to be true, and infinitely many false statements that cannot (within that system) be proven to be false. Gödel’s achievement has sometimes been over-interpreted since–as grounds for radical skepticism about the existence of truth, for example–when really all it expressed were some limitations on the possibility of formally modeling a complete system of logic from which all mathematical truths would deductively flow. Gödel gives us no reason to be skeptical of truth; he gives us reason to be skeptical of the possibility of proof, even in a domain so rigorously logical as arithmetic. In so doing, he teaches us that–in mathematics at least–truth and proof are different things.

What is true for mathematics may be true for societies as well. The relationship between truth and proof is increasingly strained online, where we spend increasing portions of our lives. Finding the tools to extract reliable information from the firehose of our social media feeds is proving difficult. The latest concern is “deepfakes”: video content that takes identifiable faces and voices and either puts them on other people’s bodies or digitally renders fabricated behaviors for them. Deepfakes can make it seem as if well-known celebrities or random private individuals are appearing in hard-core pornography, or as if world leaders are saying or doing things they never actually said or did. A while ago, the urgent concern was fake followers: the prevalence of bots and stolen identities being used to artificially inflate follower and like counts on social media platforms like twitter, facebook, and instagram–often for a profit. Some worry that these and other features of online social media are symptoms of a post-truth world, where facts or objective reality simply do not matter. But to interpret this situation as one in which truth is meaningless is to make the same error made by those who would read Gödel’s incompleteness theorems as a license to embrace epistemic nihilism. Our problem is not one of truth, but one of proof. And the ultimate question we must grapple with is not whether truth matters, but to whom it matters, and whether those to whom truth matters can form a cohesive and efficacious political community.

The deepfakes problem, for example, does not suggest that truth is in some new form of danger. What it suggests is that one of the proof strategies that we had thought bound  our political community together may no longer do so. After all, an uncritical reliance on video recordings as evidence of what has happened in the world is untenable if video of any possible scenario can be undetectably fabricated.

But this is not an entirely new problem. Video may be more reliable than other forms of evidence in some ways. But video has always proven different things to different people. Different observers, with different backgrounds and commitments, can and will justify different–even inconsistent–beliefs using identical evidence. Where one person sees racist cops beating a black man on the sidewalk, another person will see a dangerous criminal refusing to submit to lawful authority. These differences in the evaluation of evidence reveal deep and painful fissures in our political community, but they do not suggest that truth does not matter to that community–if anything, our intense reactions to episodes of disagreement suggest the opposite. As these episodes demonstrate, video was never truth, it has always been evidence, and evidence is, again, a component of proof. We have long understood this distinction, and should recognize its importance to the present perceived crisis.

What, after all, is the purpose of proof? One purpose–the purpose for which we often think of proof as being important–is that proof is how we acquire knowledge. If, as Plato argued, knowledge is justified true belief (or even if this is merely a necessary, albeit insufficient, basis for a claim to knowledge), proof may satisfy some need for justification. But that does not mean that justification can always be derived from truth. One can be a metaphysical realist–that is, believe that some objective reality exists independently of our minds–without holding any particular commitments regarding the nature of justified belief. Justification is, descriptively, whatever a rational agent will accept as a reason for belief. And in this view, proof is simply a tool for persuading rational agents to believe something.

Insofar as proof is thought to be a means to acquiring knowledge, the agent to be persuaded is often oneself. But this obscures the deeply interpersonal–indeed social–nature of proof and justification. When asking whether our beliefs are justified, we are really asking ourselves whether the reasons we can give for our beliefs are such as we would expect any rational agent to accept. We can thus understand the purpose of proof as the persuasion of others that our own beliefs are correct–something Socrates thought the orators and lawyers of Athens were particularly skilled at doing. As Socrates recognized, this understanding of proof clearly has no necessary relation to the concept of truth. It is, instead, consistent with an “argumentative theory” of rationality and justification. To be sure, we may have strong views about what rational agents ought to accept as a reason for belief–and like Socrates, we might wish to identify those normative constraints on justification with some notion of objective truth. But such constraints are contested, and socially contingent.

This may be why the second social media trend noted above–“fake followers”–is so troubling. The most socially contingent strategy we rely on to justify our beliefs is to adopt the observed beliefs of others in our community as our own. We often rely, in short, on social proof. This is something we apparently do from a very early age, and indeed, it would be difficult to obtain the knowledge needed to make our way through the world if we didn’t. When a child wants to know whether something is safe to eat, it is a useful strategy to see whether an adult will eat it. But what if we want to know whether a politician actually said something they were accused of saying on social media–or something a video posted online appears to show them saying? Does the fact that thousands of facebook accounts have “liked” the video justify any belief in what the politician did in fact say, one way or another?

Social proof has an appealingly democratic character, and it may be practically useful in many circumstances. But we should clearly recognize that the acceptance of a proposition as true by others in our community doesn’t have any necessary relation to actual truth. Your parents were wise to warn you that you shouldn’t jump off a cliff just because all your friends did it. We obviously cannot rely exclusively on social proof as a justification for belief. To this extent, as Ian Bogost put it, “all followers are fake followers.”

Still, the observation that social proof is an imperfect proxy for truth does not change the fact that it is–like the authority of video–something we have a defensible habit of relying on in (at least partially) justifying (at least some of) our beliefs. Moreover, social proof makes a particular kind of sense under a pragmatist approach to knowledge. As the pragmatists argued, the relationship between truth and proof is not a necessary one, because proof is ultimately not about truth; it is about communities. In Rorty’s words:

For the pragmatist … knowledge is, like truth, simply a compliment paid to the beliefs we think so well justified that, for the moment, further justification is not needed. An inquiry into the nature of knowledge can, on his view, only be a socio-historical account of how various people have tried to reach agreement on what to believe.

Whether we frame them in terms of Kuhnian paradigms or cultural cognition, we are all familiar with examples of different communities asserting or disputing truth on the basis of divergent or incompatible criteria of proof. Organs of the Catholic Church once held that the Earth is motionless and the sun moves around it–and banned books that argued the contrary–relying on the authority of Holy Scripture as proof. The contrary position that sparked the Galilean controversy–eppur si muove–was generated by a community that relied on visual observation of the celestial bodies as proof. Yet another community might hold that the question of which body moves and which stands still depends entirely on the identification of a frame of reference, without which the concept of motion is ill-defined.

For each of these communities, their beliefs were justified in the Jamesian sense that they “worked” to meet the needs of individuals in those communities at those times–at least until they didn’t. As particular forms of justification stop working for a community’s purposes, that community may fracture and reorganize around a new set of justifications and a new body of knowledge–hopefully but not necessarily closer to some objective notion of truth than the body of knowledge it left behind. Even if we think there is a truth to the matter–as one feels there must be in the context of the physical world–there are surely multiple epistemic criteria people might cite as justification for believing such a truth has been sufficiently identified to cease further inquiry, and those criteria might be more or less useful for particular purposes at particular times.

This is why the increasing unreliability of video evidence and social proof are so troubling in our own community, in our own time. These are criteria of justification that have up to now enjoyed (rightly or wrongly) wide acceptance in our political community. But when one form of justification ceases to be reliable, we must either discover new ones or fall back on others–and either way, these alternative proof strategies may not enjoy such wide acceptance in our community. The real danger posed by deepfakes is not that recorded truth will somehow get lost in the fever swamps of the Internet. The real danger posed by fake followers is not that half a million “likes” will turn a lie into the truth. The deep threat of these new phenomena is that they may undermine epistemic criteria that bind members of our community in common practices of justification, leaving only epistemic criteria that we do not all share.

This is particularly worrisome because quite often we think ourselves justified in believing what we wish to be true, to the extent we can persuade ourselves to do so. Confirmation bias and motivated reasoning significantly shape our actual practices of justification. We seek out and credit information that will confirm what we already believe, and avoid or discredit information that will refute our existing beliefs. We shape our beliefs around our visions of ourselves, and our perceived place in the world as we believe it should be. To the extent that members of a community do not all want to believe the same things, and cannot rely on shared modes of justification to constrain their tendency toward motivated reasoning, they may retreat into fractured networks of trust and affiliation that justify beliefs along ideological, religious, ethnic, or partisan lines. In such a world, justification may conceivably come to rest on the argument popularized by Richard Pryor and Groucho Marx: Who are you going to believe: me, or your lying eyes?

The danger of our present moment, in short, is that we will be frustrated in our efforts to reach agreement with our fellow citizens on what we ought to believe and why. This is not an epistemic crisis, it is a social one. We should not be misled into believing that the increased difficulty of justifying our beliefs to one another within our community somehow puts truth further out of our grasp. To do so would be to embrace the möbius strip of epistemology Orwell put in the mouths of his totalitarians:

Anything could be true. The so-called laws of nature were nonsense. The law of gravity was nonsense. “If I wished,” O’Brien had said, “I could float off this floor like a soap bubble.” Winston worked it out. “If he thinks he floats off the floor, and if I simultaneously think I see him do it, then the thing happens.” Suddenly, like a lump of submerged wreckage breaking the surface of water, the thought burst into his mind: “It doesn’t really happen. We imagine it. It is hallucination.” He pushed the thought under instantly. The fallacy was obvious. It presupposed that somewhere or other, outside oneself, there was a “real” world where “real” things happened. But how could there be such a world? What knowledge have we of anything, save through our own minds? All happenings are in the mind. Whatever happens in all minds, truly happens.

This kind of equation of enforced belief with truth can only hold up where–as in the ideal totalitarian state–justification is both socially uncontested and entirely a matter of motivated reasoning. Thankfully, that is not our world–nor do I belive it ever can truly be. To be sure, there are always those who will try to move us toward such a world for their own ends–undermining our ability to forge common grounds for belief by fraudulently muddying the correlations between the voices we trust and the world we observe. But there are also those who work very hard to expose such actions to the light of day, and to reveal the fabrications of evidence and manipulations of social proof that are currently the cause of so much concern. This is good and important work. It is the work of building a community around identifying and defending shared principles of proof. And I continue to believe that such work can be successful, if we each take up the responsibility of supporting and contributing to it. Again, this is not an epistemic issue, it is a social one.

The fact that this kind of work is necessary in our community and our time may be unwelcome, but it is not cause for panic. Our standards of justification–the things we will accept as proof–are within our control, so long as we identify and defend them, together. Those who would undermine these standards can only succeed if we despair of the possibility that we can, across our political community, come to agreement on what justifications are valid, and put beliefs thus justified into practice in the governance of our society. I believe we can do this, because I believe that there are more of us than there are of them–that there are more people of goodwill and reason than there are nihilist opportunists. If I am right, and if enough of us give enough of our efforts to defending the bonds of justification that allow us to agree on sufficient truths to organize ourselves towards a common purpose, we will have turned the totalitarian argument on its head. Orwell’s totalitarians were wrong about truth, but they may have been right about proof.

A Personal Take on Aereo

Screen Shot 2014-06-25 at 11

Until yesterday, I was an Aereo subscriber. My family lives in a fairly large co-op apartment complex in Upper Manhattan. Our building’s residents have collectively contracted for our own broadband internet service, so we get a cheap, reliable high-speed connection without having to deal directly with a cable company or purchase all their bundled services at retail. For entertainment, we pay for subscription streaming services like Netflix, Amazon, Hulu, and Spotify, supplemented with occasional purchases of content not available to stream. Collectively these subscriptions actually cost us quite a bit less than the basic cable TV package offered by our local monopolist, TimeWarner Cable (soon to be Comcast), and offer more variety, convenience, and reliability.

One thing we don’t get from this array of IP-based streaming services is live broadcast television. So a few months ago I purchased a digital TV antenna to catch the occasional live sporting event, pbs kids show, or network drama. But our apartment is on a low floor, in a hilly area of the city, surrounded by other late Art Deco-era buildings all built of steel and thick poured concrete sheathed in brick and stone. No matter where in our apartment I put the antenna, I couldn’t pick up the over-the-air broadcast TV signals being transmitted from just a few miles away in midtown Manhattan–signals that are reliably received in homes across the street, or a few stories above mine, or in less-densely built areas as much as eighty miles away.

If I were able to pick up such transmissions using the antenna I bought, copyright law would afford me the right to view the broadcasted programs in my home with “a normal circle of a family and … social acquaintances“, and even “time-shift” by recording them for viewing later. But my television set is in a physical space that happens, due to particularities of the physics of the propagation of electromagnetic waves, to differ from the physical spaces all around it in that broadcast TV signals have particular trouble reaching it.

What I needed was to put my antenna slightly outside my apartment and send the received signal inside to my television set. Enter Aereo. As described by the Supreme Court in its opinion (with some simplification on my part):

Aereo’s system is made up of servers, transcoders, and thousands of dime-sized antennas housed in a central warehouse…. [O]ne of Aereo’s servers selects an antenna, which it dedicates to the use of [a] subscriber (and that subscriber alone) for the duration of the [subscriber’s] selected show. A server then tunes the antenna to the over-the-air broadcast carrying the show. The antenna begins to receive the broadcast, and … Aereo’s server begins to stream the … show to the subscriber over the Internet.

Two commentators I admire and respect have written (here and here) that this system can be seen as analogous to a homeowner putting their TV antenna on the roof of their house to get better reception.  There’s a bit more to Aereo than that, but truly, that’s all my family wanted: an antenna in a more suitable location than our living room, with a wire connecting it to our TV.  We signed up.

Yesterday the Supreme Court decided that city-dwellers like me who use Aereo’s remote antennae are more like cable customers subscribing to a common antenna than like suburban homeowners who put antennae on their roofs, and that Aereo is more like a cable company than a property owner renting us some useful space and equipment. Justice Breyer’s decision for the majority was deeply purposivist, relying on an interpretation that the community-antenna (CATV) provisions of the Copyright Act of 1976 reflected a broad-brush Congressional policy about what types of uses of broadcasted content require a license. Those policies appear to depend less on “technological difference[s]” than on social ones–the different permutations of arrangements between content owners, users, intermediaries, and the physical resources under their control.

The key phrase in the opinion, to my mind, is the one that implies that families like mine “lack any prior relationship to the [copyrighted] works” transmitted over the air by their broadcasters.  To be clear, my relationship to the works is based on real estate: I own a home situated a few yards away from where television broadcasts can be pulled from the air, for free, by means of a consumer-grade antenna.  This appears not to be the type of relationship that the Supreme Court thinks entitles me to contract with a third party for the use of nearby real estate and equipment to pull those same broadcasts from the air.  As a consumer of entertainment content, this conclusion strikes me as a minor inconvenience–the content is not worth that much to me, and I suppose I will simply go without it now.  As a law professor though, the conclusion strikes me as…curious.

Most commentators are focused on the implications of the Court’s ruling for cloud-based services, and that is an interesting question.  But for me the more interesting question is what Aereo says about the framework of laws and practices by which we allocate responsibility for the creation of new knowledge.  In the classic telling, copyright is a tool by which we purport to satisfy a social obligation to creators of new works of authorship.  Depending on whom you ask, this obligation is either a collective obligation to establish appropriate incentives for authors, or a moral one in recognition of the authors’ desert or dignity. Aereo certainly didn’t call into question whether such an obligation exists, and I don’t either.  My question is how a society allocates among its members the burdens of satisfying that obligation.  This is a question that, as it turns out, is occupying a lot of my research and thinking lately.

Through a combination of the principles of electromagnetism played out across the natural and built environment and the historical accidents of technological progress and time-worn statutes, we seem to be in the position of allocating the burdens of supporting authorship at least in part via the real estate market.  That seems to me an arbitrary basis by which to allocate these burdens. Indeed, it seems so arbitrary that there must be some quite important reason why the Aereo majority–which took a rather free-wheeling approach to determining statutory purpose–would feel the need to preserve it.

Understanding what those reasons might be is a bigger project than a blog post can contain.  I will continue to work on the problem. For now though, I think I’ll watch some TV.