MundaneBlog

Reading the always wonderful “Pivot to AI” by Amy Castor and David Gerard, and they link to a great 2019 piece by Os Keyes, “The Body Instrumental” which was new to me and enjoyable. Well, enjoyable in that particular way that any sufficiently prescient and worrying thing can be enjoyable. I have been thinking briefly as of late on heteronormativity, so both articles were a great coincidence.

I can’t restate any point not already sufficiently covered by the two articles above, but it really does strike me that any such “gender determining” (perhaps really “sex determining” in the end is their goal, reflecting the binary and exclusive nature of sex and gender for them, not that either is so binary as they think) AI will be inescapably heteronormative (perhaps “gender normative”, as I am speaking mostly in the gender, expression, and such things realm, not in the relational sense, although I take the term to apply to both. I can not claim to be an experienced scholar of gender, so forgive me if my terminology is incorrect. I was just reading Sex in Public, so, like, 1998?. Still very much a relevant work in my mind, but my cognition is biased towards that which I can remember in the moment).

The training data is classified first by humans, who will have to fit each photo into a binary category, man or woman. Most of the data will likely be of people who “pass” or perform gender in the correct way, simply owing to the dominance of such images in the training data. Movies, photos, public domain images, et cetera. Simply by volume alone the normative wins out, and therefore any such AI will be biased in its favor. It will be biased to fit people into these categories.

Turning to prognostication, who will be allowed to opt out? To gate access to a room or facility behind such an AI means that the non-normative, the queer, will be penalized. Even if one is notionally allowed to opt out, the process of doing so may very well lead to further stigmatization simply by virtue of being the different one.

As Keyes states: “We should focus on delegitimizing the technology altogether, ensuring it never gets integrated into society, and that facial recognition as a whole (with its many, many inherent problems) goes the same way.”

I could not have said it better or any earlier. You simply must read the whole article, as the portion on how the AI will reshape gender in its image is brilliant and gets to the very heart of not just the AI problem, but of problems of gender in society more broadly.