{"id":22042,"date":"2016-12-21T11:52:08","date_gmt":"2016-12-21T15:52:08","guid":{"rendered":"https:\/\/thesocietypages.org\/cyborgology\/?p=22042"},"modified":"2016-12-21T12:03:17","modified_gmt":"2016-12-21T16:03:17","slug":"22042","status":"publish","type":"post","link":"https:\/\/thesocietypages.org\/cyborgology\/2016\/12\/21\/22042\/","title":{"rendered":"A Historical Lens For Machine Vision"},"content":{"rendered":"

\"screen-shot-2016-12-21-at-7-38-43-am\"<\/a><\/p>\n

Over at The New Inquiry<\/em>, an excellent piece<\/a> by Trevor Paglen about machine-readable imagery was recently posted. In \u201cInvisible Images (Your Pictures Are Looking at You)\u201d, Paglen highlights the ways in which algorithmically driven breakdowns of photo-content is a phenomenon that comes along with digital images. When an image is made of machine-generated pixels rather than chemically-generated gradations, machines can read these pixels, regardless of a human\u2019s ability to do so. With film, machines could not read pre-developed exposures. With bits and bytes, machines have access to image content as soon as it is stored. The scale and speed enabled by this phenomenon, argues Paglen, leads to major market- and police-based implications.<\/p>\n

Overall, I really enjoyed the essay\u2014Paglen does an excellent job of highlighting how systems that take advantage of machine-readable photographs work, as well as outlining the day-to-day implications of the widespread use of these systems. There is room, however, for some historical context surrounding both systematic photographic analysis and what that means for the unsuspecting public.<\/p>\n

<\/p>\n

Specifically, I\u2019d like to point to Allan Sekula\u2019s landmark 1986 essay<\/a>, \u201cThe Body and the Archive\u201d, as a way to understand the socio-political history of a data-based understanding of photography. In it, Sekula argues that photographic archives are important centers of power. He uses Alphonse Bertillon and Francis Galton as perfect examples of such: the former is considered the reason why police forces fingerprint, the latter is the father of eugenics and\u2014most relevant to Sekula\u2014inventor of composite portraiture.<\/p>\n

So when Paglen notes that \u201call computer vision systems produce mathematical abstractions from the images they\u2019re analyzing, and the qualities of those abstractions are guided by the kind of metadata the algorithm is trying to read,\u201d I can\u2019t help but think about the projects by Bertillon and Galton. These two researchers\u00a0believed that mathematical abstraction would provide a truth\u2014one from the aggregation of a mass of individual metrics, the other from a composition of the same, but in photographic form.<\/p>\n

Certainly, Paglen has read Sekula\u2019s piece\u2014the New Inquiry<\/em> essay often references \u201cvisual culture of the past\u201d or \u201cclassical visual culture\u201d and \u201cThe Body and the Archive\u201d played a major part in the development of visual culture studies. And it\u2019s important to note that my goal in referencing the 1986 piece is not to dismiss Paglen\u2019s concerns as \u201cnothing new.\u201d Rather, I think it\u2019s important to consider the \u201cnot-new-ness\u201d of the socio-political implications of these image-reading systems (see: 19th<\/sup><\/span> century scientists trying to determine the \u201caverage criminal face\u201d) alongside<\/i> the increased speed and \u201caccuracy\u201d of the technology. That is, this is something humans have been trying to do for hundreds of years, but now it is more widely integrated into our day-to-day.<\/p>\n

At the end of his essay, Paglen offers a few calls to action:<\/p>\n

\n

To mediate against the optimizations and predations of a machinic landscape, one must create deliberate inefficiencies and spheres of life removed from market and political predations\u2013\u201csafe houses\u201d in the invisible digital sphere. It is in inefficiency, experimentation, self-expression, and often law-breaking that freedom and political self-representation can be found.<\/p>\n<\/blockquote>\n

I really like these suggestions, though I\u2019d offer one more: re-creation. That is, what if we asked our students to recreate the type of abstracting experiments performed by the likes of Galton and Bertillon, but to use today\u2019s technology? Better yet, what if we asked them to recreate today\u2019s machine-reading systems using 19th<\/sup><\/span> century tools? This sort of historical-fictive practice doesn\u2019t require students\u2019 experiments to \u201cwork\u201d, per se. Rather, it asks them to consider the steps taken and decisions made along the way. The whys and hows and wheres. In taking on this task, students might be able to more concretely connect the subjectivity inherent in our present-day systems by calling out the individual decisions that need to be made during their development. We might illustrate possible motives behind projects like Google DeepDream or Facebook\u2019s DeepFace.<\/p>\n

Within our new algorithmic watchmen are embedded a plethora of stakeholders and the things they want or need. Paglen, unfortunately, doesn\u2019t do a very good job reminding us of this (he paints a picture, so to speak, of machines reading machines, but forgets that said machines must be programmed by humans at some point). And I\u2019d be curious to know what he had mind when he refers to\u00a0\u201csafe houses\u201d without \u201cmarket or political predations\u201d (as a colleague recently reminded me, even the Tor project can thank<\/a> the US government for its existence).<\/p>\n

To conclude, I’d like to highlight an important project by an artist named Zach Blas, Facial Wesponization Suite <\/i><\/a>(2011-2014). The piece is meant as a protest against facial recognition software in both consumer-level devices, corporate and governmental security systems, and research efforts. \u201cOne mask,\u201d writes Blas, \u201cthe Fag Face Mask, generated from the biometric facial data of many queer men\u2019s faces, is a response to scientific studies that link determining sexual orientation through rapid facial recognition techniques.\u201d Blas uses composite 3D scans of faces to build masks that confuse facial recognition systems.<\/p>\n

\"Facial<\/a>Facial Weaponization Suite<\/em> by Zach Blas<\/sub><\/p>\n

This project is important here for two reasons: firstly, it’s an example of exactly the kind of thing Paglen says won’t work (\u201cIn the long run, developing visual strategies to defeat machine vision algorithms is a losing strategy,\u201d he writes). But that’s only true if you see Facial Weaponization Suite<\/em>\u00a0as simply a means to confuse the software<\/i>. On the other hand, if you recognize the performative nature of the work\u2014individuals walking around in public wearing bright pink masks of amorphous blobs\u2014you quickly understand that the piece can also confuse humans<\/i>, i.e., bystanders, hopefully bringing an awareness of these machinic systems to the fore.<\/p>\n

Wearing the masks in public, however, can be a violation of\u00a0some\u00a0state<\/a> penal<\/a> codes<\/a>, which brings me to my second point. Understanding the technology here is not enough. Rather, the technology must be studied in a way that incorporates multiple disciplines: history, of course, but also law, biomedicine, communication hierarchies and infrastructure, and so on.<\/p>\n

To be clear, I see Paglen’s essay as an excellent starting point. It begins to bring to our attention what makes our machine-readable world particularly dangerous without tripping any apocalyptic warning sirens. Let’s see if we can’t take it a step further, however, by taking a few steps back.<\/p>\n

Gabi Schaffzin<\/a> is a PhD student in Visual Arts, Art Practice at UC San Diego. He wears his sunglasses at night.<\/p>\n","protected":false},"excerpt":{"rendered":"

Over at The New Inquiry, an excellent piece by Trevor Paglen about machine-readable imagery was recently posted. In \u201cInvisible Images (Your Pictures Are Looking at You)\u201d, Paglen highlights the ways in which algorithmically driven breakdowns of photo-content is a phenomenon that comes along with digital images. When an image is made of machine-generated pixels rather […]<\/p>\n","protected":false},"author":2071,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[892],"tags":[43084,43085,43086,2708,43083,253,321,43082,43080,16156,43087],"class_list":["post-22042","post","type-post","status-publish","format-standard","hentry","category-essay","tag-allan-sekula","tag-alphonse-bertillon","tag-computer-vision","tag-facial-recognition","tag-francis-galton","tag-history","tag-law","tag-machine-readable","tag-masks","tag-new-inquiry","tag-tor"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/posts\/22042","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/users\/2071"}],"replies":[{"embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/comments?post=22042"}],"version-history":[{"count":2,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/posts\/22042\/revisions"}],"predecessor-version":[{"id":22047,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/posts\/22042\/revisions\/22047"}],"wp:attachment":[{"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/media?parent=22042"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/categories?post=22042"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/tags?post=22042"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}