by Mark R. DeLong at 3 Quarks Daily: Duke law professor James Boyle said an article on AI personhood gave him some trouble. When he circulated it over a decade ago, he recalled, “Most of the law professors and judges who read it were polite enough to say the arguments were thought provoking, but they clearly thought the topic was the purest kind of science fiction, idle speculation devoid of any practical implication in our lifetimes.” Written in 2010, the article, “Endowed by Their Creator?: The Future of Constitutional Personhood,” made its way online in March 2011 and appeared in print later that year. Now, thirteen years later, Boyle’s “science fiction” of personhood has shed enough fiction and fantasy to become worryingly plausible, and Boyle has refined and expanded his ideas in that 2011 article into a new thoughtful and compelling book.
In the garb of Large Language Models and Deep Learning, Artificial Intelligence has shocked us with their uncanny fluency, even though we “know” that under the hood the sentences come from clanky computerized mechanisms, a twenty-first century version of the Mechanical Turk. ChatGPT’s language displays only the utterance of a “stochastic parrot,” to use Emily Bender’s label. Yet, despite knowing the absence of a GPT’ed self or computerized consciousness, we can’t help but be amazed or even a tad threatened when an amiable ChatGPT, Gemini, or other chatbot responds to our “prompt” with (mostly) clear prose. We might even fantasize that there’s a person in there, somewhere.
Boyle’s new book, The Line: AI and the Future of Personhood (The MIT Press, 2024) forecasts contours of arguments, both legal and moral, that are likely to trace new boundaries of personhood. “There is a line,” he writes in his introduction. “It is a line that separates persons—entities with moral and legal rights—from nonpersons, things, animals, machines—stuff we can buy, sell, or destroy. In moral and legal terms, it is the line between subject and object.”
The line, Boyle claims, will be redrawn. Freshly, probably incessantly, argued. Messily plotted and retraced.
The arguments about where the line should run will play out during this century—and will never be completely resolved, at that. Boyle’s book makes three main points: “First, our culture, morality, and law will have to face new challenges to what it means to be human, or to be a legal person—and those two categories are not the same.” The challenges would arise from a sentience, an upsetting or even defiant intelligence recognizable in “synthetic entities” like AI or genetically engineered human-animal. Granting personhood, remember, does not itself bestow all rights; “corporations are people, friend” (Mitt Romney’s memorable quip during his 2012 Presidential campaign) doesn’t mean corporations have the right to vote, for example, even though corporations are the most obvious examples of non-living entities granted personhood in the eyes of the law. The second point is that “we have not thought adequately about the issue, either individually or as a culture,” leading quite naturally to Boyle’s third point that “the debate will not play out in the way that you expect” in large part because, well, the issue is indeed complicated.
The challenges run into prior religious, moral, and legal stakes that demarcate other boundaries; the moral and legal implications of AI-personhood or chimera-personhood will conflict, qualify, and seep into other definitions of personhood, established in law or envisioned. But beyond complex and passion-fueled argument, sloppy thinking and even fraudulent claims can plague the debate. Boyle’s revealing discussion of how corporate personhood played out in law (chapter 3) shows this. He believes that corporate personhood might be seen as a possible rehearsal of debates about AI personhood. In his 2011 article, Boyle observes that the “history of corporate personhood is hardly one of the Constitution’s shining moments”; in his 2024 book he explains why.