{"id":20254,"date":"2015-08-05T14:48:32","date_gmt":"2015-08-05T18:48:32","guid":{"rendered":"http:\/\/thesocietypages.org\/cyborgology\/?p=20254"},"modified":"2015-08-05T14:59:00","modified_gmt":"2015-08-05T18:59:00","slug":"algorithmic-triggering","status":"publish","type":"post","link":"https:\/\/thesocietypages.org\/cyborgology\/2015\/08\/05\/algorithmic-triggering\/","title":{"rendered":"Algorithmic Triggering"},"content":{"rendered":"
\"Would<\/a>
Would if this were true?<\/figcaption><\/figure>\n

The Facebook newsfeed is the subject of a lot of criticism, and rightly so. Not only does it impose an echo chamber on your digitally-mediated existence, the company constantly tries to convince users that it is user behavior<\/a> \u2013not their secret algorithm\u2014that creates our personalized spin zones. But then there are moments when, for one reason or another, someone comes across your newsfeed that says something super racist or misogynistic and you have to decide to respond or not. If you do, and maybe get into a little back-and-forth, Facebook does a weird thing: that person starts showing up in your newsfeed a lot more.<\/p>\n

This happened to me recently and it has me thinking about the role of the Facebook newsfeed in inter-personal instantiations of systematic oppression. Facebook\u2019s newsfeed, specially formulated to increase engagement by presenting the user with content that they have engaged with in the past, is at once encouraging of white allyship against oppression and <\/i>inflicting a kind of violence on women and people of color. The same algorithmic action can produce both consequences depending on the user.<\/p>\n

For the white and cis-male user the constant reminder that you have some social connection to a racist person might encourage (or at least afford<\/a> the opportunity that) you take that person to task. After all, white allyship is something you do<\/a>, not a title that you put in your Twitter bio. There are, of course, lots of other (and better) ways to be an ally but offering some loving criticism to acquaintances and loved ones can make positive change over time. It is almost, for a moment, as if Facebook has some sort of anti-racist feature: something that puts white men in the position to do the heavy lifting for once and confront intersecting forms of oppression instead of leaving it up to the oppressed to also<\/i> do the educating.<\/p>\n

The same algorithmic tendency to continually show those you have interacted with, as if all intense bouts of interaction are signs of a desire for more interaction, can also be an instigator and propagator of those same sorts of oppression. An argument can turn into a constant invitation for harassment because, just as you see more of your racist acquaintance, so too do they see you. This could lead to more baiting for arguments and more harassment. But even if this does not happen, the incessant racist memes that now show up in your timeline are themselves psychically exhausting. This algorithmic triggering –the automated and incessant display of disturbing content– \u00a0is especially insidious because it is inflicted on users who stood up to hateful content in the first place.<\/p>\n

This agnosticism towards content in favor of \u201cengagement\u201d for its own sake is remarkably flat-footed given all the credit we give Facebook for being able to divine intimate details and compose them into a frightening-as-it-is-obscured \u201cgraph\u201d of our performed self. If we wanted to keep the former instance (encouraging ally behavior) but reduce the possibility of the latter (algorithmic triggering) what might we request? How can something like Facebook be sensitive to issues of race, class, and gender?<\/p>\n

One option might also use some sort of image-recognition technology that gives the user the option to unhide a hateful image rather than see it by default. \u00a0If Facebook can detect my face it can certainly detect the rebel flag or even words printed onto image macros. Yik Yak, for example, does not allow photos of human faces<\/a> and implements that rule through face detection technology. If your photo has a face in it, the app doesn\u2019t let you post it. If a social media company can effectively weather free speech extremists\u2019 outrage<\/a>, they might be able to impose some mild palliatives to potentially upsetting content.<\/p>\n

The problem with these interventions is that it requires that Facebook collect and act on even more information. It asks that Facebook redouble their efforts to collect and analyze data that determines race and ethnicity. It asks them to study photos and proactively show and hide them. It also falling into some of the issues I\u2019ve raised in the past<\/a> about trying to write broad laws to eliminate very specific kinds of behavior. That seems to be the wrong direction.<\/p>\n

The Occam\u2019s razor solution is to have Facebook adopt some sort of anti-racist and\/or anti-sexist policy where it pits those people who have demonstrated anti-racist tendencies, against those with more retrograde viewpoints. The algorithm could be tweaked so that white people who have espoused anti-racist sentiments in the past are paired with their \u201cfriends\u201d that think the confederate flag is about heritage or whatever. Men who have shared content with a feminist perspective could be paired with men who wear fedoras. All the while controlling and modulating who sees whom so that the burden of teaching and consciousness-raising isn\u2019t unevenly distributed to those that bear the brunt of hate.<\/p>\n

This actively imposed context collapse is admittedly improbable \u2013I know there\u2019s no chance that Facebook would decide to do this\u2014but thinking through the implementation of such a policy is a good thought experiment. It highlights the embedded politics of Facebook\u2014a platform that would rather have us be happy and sharing than critical and counterposed. Engagement with brands not only requires active contributions to the site, but positive feelings that can be usurped for the benefit of brands. Deeper still, social media as an industry is deeply committed to the \u201cview from nowhere<\/a>\u201d where hosts to conversation are only allowed to intervene in the most egregious of circumstances, almost always as a reaction to a user complaint, and never as part of a larger political orientation.<\/p>\n

Even the boardroom feminism of their own Sheryl Sandberg is largely absent. As far anyone can tell, there is nothing in the Facebook algorithm that encourages women to \u201clean in\u201d in Facebook-hosted conversations. Such a technological intervention \u2013and we could have fun thinking about how to design such a thing– could have done just as much, if not more, than the selling of a book and a few TED talks. For example, imagine if Facebook suddenly\u00a0put the posts and comments of self-identified women at the top and buried men’s. Maybe for just a few days.<\/p>\n

Perhaps we should simply cherish and make the most of the moments when the algorithms in our lives start inadvertently working towards the betterment of society. I\u2019m going to keep calling out that racist person on Facebook and while that certainly doesn\u2019t qualify me for a reward or really even a pat on the back, it is (for me) something that doesn\u2019t take a lot of time or effort and might possibly make the world (or that one person) marginally better.<\/p>\n

I do not think anyone, at the present moment, is suited to offer a viable proposal for leveraging the Facebook algorithm to promote allyship or even reduce what I\u2019ve been calling algorithmic triggering. Those with the relevant backgrounds, either through formal education or past experience, are missing from the board rooms where the salient decisions are being made. Conversely, those in the board rooms that actually know how the algorithm works, what it is capable of, and are poised to monetarily gain (and lose) from Facebook\u2019s ability to attract advertisers are not necessarily the best people to make these sorts of political design choices. \u00a0Perhaps the best way to think of algorithmic triggering is the automation of\u00a0“if it bleeds it leads” editorial choices. The\u00a0decision to show violent and disturbing video (of police officers murdering black people for example) can be motivated by good intentions but can lead to an impossibly cruel media landscape. Obviously we should all be fighting to end the events that are the subject of this disturbing media but for now we would do well to demand that the gatekeepers of (social) media take our collective mental health into consideration. What that looks like, is yet to be seen.<\/p>\n

David<\/a> is on twitter<\/a> and tumblr<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

The Facebook newsfeed is the subject of a lot of criticism, and rightly so. Not only does it impose an echo chamber on your digitally-mediated existence, the company constantly tries to convince users that it is user behavior \u2013not their secret algorithm\u2014that creates our personalized spin zones. But then there are moments when, for one […]<\/p>\n","protected":false},"author":1512,"featured_media":20255,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[9967],"tags":[18447,33095,18606,18422,18444,19932,2702,942,245,10414,12285,565,9166,18361,18328,732,18441,133],"class_list":["post-20254","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-commentary","tag-affordances","tag-algorithm","tag-algorithms","tag-automation","tag-context-collapse","tag-conversation","tag-experience","tag-facebook","tag-feminism","tag-harassment","tag-memes","tag-mental-health","tag-oppression","tag-people-of-color","tag-sheryl-sandberg","tag-social-media","tag-trolling","tag-violence"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/thesocietypages.org\/cyborgology\/files\/2015\/08\/16934644455_3fea8378d9_z.jpg","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/posts\/20254","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/users\/1512"}],"replies":[{"embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/comments?post=20254"}],"version-history":[{"count":4,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/posts\/20254\/revisions"}],"predecessor-version":[{"id":20259,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/posts\/20254\/revisions\/20259"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/media\/20255"}],"wp:attachment":[{"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/media?parent=20254"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/categories?post=20254"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/tags?post=20254"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}