{"id":17284,"date":"2013-10-17T23:16:01","date_gmt":"2013-10-18T03:16:01","guid":{"rendered":"http:\/\/thesocietypages.org\/cyborgology\/?p=17284"},"modified":"2013-10-17T23:16:01","modified_gmt":"2013-10-18T03:16:01","slug":"by-whom-for-whom-science-startups-and-quantified-self","status":"publish","type":"post","link":"https:\/\/thesocietypages.org\/cyborgology\/2013\/10\/17\/by-whom-for-whom-science-startups-and-quantified-self\/","title":{"rendered":"By Whom, For Whom? Science, Startups, and Quantified Self"},"content":{"rendered":"
\"#qs13<\/a>
#qs13 took place in San Francisco’s Presidio. Image credit: Whitney Erin Boesel<\/figcaption><\/figure>\n

It\u2019s almost a week now since I attended the 2013 Quantified Self Global Conference<\/a> in San Francisco, and I\u2019m still not sure where to begin with my summary of the event itself. Instead of jumping in with an overview, this time I\u2019ll cover my own session\u2014in which what started out as asking how researchers studying Quantified Self could better connect with each other became an (at times) intense debate about what Quantified Self is, what Quantified Self should be, and what role (if any) academic or institutional research and researchers should have within the Quantified Self community.<\/p>\n

At QS Global 2013, I led a breakout session with Jakob Eg Larsen<\/a> titled simply, \u201cQS Researchers<\/a>.\u201d Jakob and I had proposed similar sessions for the conference, and were happy to work together after an introductory email from the organizers. We were both well aware of the growing academic interest in Quantified Self, and eager to find ways for members of the expanding QS researcher community to network and collaborate with each other. What would be most useful, and what might other researchers be interested in? I\u2019d tried to start a Google Group mailing list following QS Global 2012, but that hadn\u2019t really gotten off the ground; truth be told, I\u2019m already up to my eyeballs in email, and I suspect many others are in the same position. But what about organizing a pre-conference attached to the Quantified Self Conferences, at which people could present their research and simultaneously get feedback both from other professional researchers and from non-researcher members of QS? What about an informal networking event attached to the QS Conferences? How could we involve researchers who were working in this area, but not able to attend either QS Global or QS Europe? (Was anyone present connected to the Quantified Self Research Network<\/a> we\u2019d heard about?) What about starting a QS-related journal\u2014what might that look like? And how could we ensure that our efforts to connect with each other as researchers remained open and accessible to the rest of the Quantified Self community, rather than turning into an us\/them ivory tower situation?<\/p>\n

\u201cCome meet scientists and scholars for whom Quantified Self is a research topic,\u201d the description read. \u201cWe will continue the conversation that began at last year\u2019s conference, and welcome new participants.\u201d What I wasn\u2019t expecting was that the session not only came back to that conversation, but also returned to some of the questions that came up in my QS Europe 2013 session<\/a> about who is and isn\u2019t a part of the Quantified Self community\u2014and sparked an at times intense discussion about what the role of academic researchers is and should be within Quantified Self.<\/p>\n

Our breakout was in the last set of sessions at QS Global 2013, and Jakob and I were pleasantly surprised to find ourselves expanding the circle of chairs out, out, and then out again as people kept trickling in; eventually, the ring was as wide as the room itself. As we went around with brief introductions (name, any affiliation, and three word description of research interests), I counted 31 people total: 21 men and 10 women; 26 professional researchers (academic, industry, or other) and 5 non-researchers interested in research (one of whom was an organizer of the QS meetup group in his city)[i]<\/a>. We then posed our questions: I asked what sorts of opportunities or infrastructures people would find useful in terms of exchanging ideas and exploring collaborations, and Jakob asked how a more formalized academic event might be either attached to or integrated into the QS Conferences. For shorthand I labeled these two possible developments \u201cinformal\u201d and \u201cformal\u201d on a pair of giant sticky notes, and we opened the discussion.<\/p>\n

\""QS<\/a>
“QS Researchers” breakout session at #qs13. Image credit: James McCarter<\/figcaption><\/figure>\n

And then things went in some directions I hadn\u2019t anticipated.<\/p>\n

\u201cIt would be nice to maybe bring up the quality of work of people who do QS, and make their work better,\u201d one man said. In summary, a lot of QS projects just didn\u2019t look like Proper Science\u2122 to him\u2014and that wasn\u2019t the only problem. He also suggested that we \u201cdocument some of these projects, so that people can, you know, not do the same thing over and over again\u2026and god forbid, reference something that happened before.\u201d (A wave of knowing laughter passed through the room: uh-oh.) Another man chimed in talking about the value of citations, and how academics use them to show \u201can epistemological trail,\u201d thereby establishing the validity of their ideas. Bringing citations into Quantified Self would not only make QS projects more rigorous, but would create the conditions necessary for instituting a system of peer review. He suggested that, next year, the research community should host a breakout session about \u201cwhy [academics] have conversations the way we have them,\u201d and thereby teach Quantified Self about the value of formal academic systems of knowledge production and dissemination. A third man bemoaned the fact that most QS documentation is in video format, saying, \u201cWe don\u2019t want to have to sit and look at a video for 20 minutes. Having something on paper is just much more convenient than that.\u201d Why couldn\u2019t all these people manage to write academic papers instead?<\/p>\n

This theme\u2014which I\u2019ll call \u2018QS is Bad Science\u2019\u2014came up again and again during our conversation. Put simply, these researchers saw the self-tracking projects of Quantified Self as \u201cscience,\u201d but as an inferior kind of science\u2014a homespun, feral science that aspires to produce knowledge for the greater good, but that desperately needs to be educated, disciplined, and restructured in the image of academic\/institutional science. A variation on this theme that also came up (although less often) was one I\u2019ll call \u2018QS is Great Science\u2019; these researchers felt that n=1 studies have a lot to teach academic\/institutional science, if only QSers could learn to speak academic\/institutional science\u2019s language so that these beleaguered researchers could have \u201cproof\u201d of what goes on at Quantified Self to bring back for their doubting colleagues. One man in particular pointed out that, for the institution that could turn n=1 into n=\u201cus,\u201d n=1 experiments could revolutionize science by providing an infinite pool of opt-in, unpaid participants for clinical trials. (The implication here: if you harness enthusiasm for n=1 experiments correctly, you can subtract both paying for subject recruitment and<\/i> paying your research subjects\u2019 time from your study\u2019s budget, and maybe subtract paying for the IRB review, too. In an era of ever-decreasing grant monies, who doesn\u2019t love free labor?)<\/p>\n

To me, as a social scientist, this was setting off all sorts of alarm bells\u2014the paternalism alone made me draw connections both to missionaries and to colonialism generally, and that\u2019s never a good thing. (Though it\u2019s bizarre to liken a group of highly privileged, mostly white people to a First Nation, it was clear to me that a number of researchers were viewing Quantified Self either as the \u201cnoble savages\u201d who would save starving Science with gifts of barley and corn, or as \u201csavage heathens\u201d who needed new names, new clothes, a new religion, and new jobs serving their \u201ccivilized\u201d masters.) This line of discussion also evidenced a profound blindness to the character of Quantified Self itself: in two-and-a-half years, I\u2019ve never once heard a QSer lament not being able to publish their Show&Tell presentation in an academic publication. At the Open Science Summit<\/a>? Sure. At OSS 2011, there were several conversations about how to get n=1 studies into academic journals\u2014and I do know that there is overlap between QS and OSS. Still, your average QSer isn\u2019t sobbing into her spreadsheets and wishing that she could grapple with arcane citation practices and grueling peer review processes. Quantified Self, at the macro level and on the whole, is not striving for institutional legitimacy. Frankly, QS just doesn\u2019t care.<\/p>\n

\"honey_badger_doesnt_care_warning_label_sticker-r955c69e0c59547f19ca1229d77b6d285_v9wf3_8byvr_512\"<\/a><\/p>\n

As often as Quantified Self gets likened to a movement\u2014and as much as quantrepreneurs<\/a> like to ask, \u201cHow can we get more people to track (and in so doing provide us with More Data for our Big Data Whatever)?\u201d\u2014the overall culture of Quantified Self simply is not evangelical<\/a>. It\u2019s about everyone doing what\u2019s right for him- or her individual self, as she or he defines both \u201cself\u201d and \u201cright.\u201d It\u2019s about adopting what \u201cworks\u201d (for you), and ignoring what doesn\u2019t: To thine own self be true<\/i>. What half the room seemed to be missing, however, is that this principle applies as much to medical advice and to academic research findings as it does to individual Show&Tell presentations. As I noted<\/a> during my very first QS Researchers breakout session at QS Global 2012, the greater Quantified Self community is open and even welcoming to researchers, but it admits them as equals, not as authorities. This should have been obvious to anyone at QS Global 2013 in particular, as several of the plenaries featured stories of people who had second-guessed their doctors (aka: formal, institutional knowledge), then provided their own second opinions through tracking, and redirected their treatment courses, and ended up the better for it. By now, during the very last session of the conference, why would anyone think that what Quantified Self wants is to become the Mini Me of academic\/institutional research?<\/p>\n

As it turned out, I wasn\u2019t the only one picking up on this disjuncture. As the one man who had identified himself as an organizer of a QS meetup group said,<\/p>\n

Gary [Wolf] in particular is particularly wedded to the concept that this is a community. The point here is actually not data, not science; it\u2019s people sitting together<\/i>.<\/b> In fact, you could knock out the talks, and he\u2019d say the event would still be here, that people would come. He wouldn\u2019t care if they\u2019re small conversations, and if nothing goes on paper\u2014I\u2019m sure you\u2019ve noticed the frustration, \u201cNothing\u2019s on paper!\u201d and \u201cSo informal!\u201d and\u2014that\u2019s consciously done that way, to create this character.\u201d<\/p><\/blockquote>\n

He went on to reiterate the general sentiment toward researchers that I\u2019d picked up at QS Global 2012:<\/p>\n

Unless you want to provoke that kind of reaction\u2014do an immunology experiment\u2014you\u2019ve got to find a way to [organize as academics] that doesn\u2019t set it off. I don\u2019t think you want to run a track at the conference, because that\u2019s fragmenting the conference. If you said, \u201cLet\u2019s come a day early and meet, and then go study these animals,\u201d that\u2019s\u2014I think we\u2019re happy to have you study us, in fact, [the conference organizers] will love it, that\u2019s fine, study us\u2014but don\u2019t try to change what we\u2019re doing because [the conference organizers] have got this formula that they like, and we\u2019re all getting something good out of it.<\/p><\/blockquote>\n

A woman voiced her opposition to the proposed formalization of Quantified Self by referencing the QS \u201cmission statement.\u201d While I don\u2019t know that Quantified Self has a formal mission statement (at least not in the way my old non-profit job did), her point still stands:<\/p>\n

You came to the community of QS, which has a mission statement. And the mission statement is contra to what you want to do. It\u2019s about the peers, and it\u2019s about the individual self. Community.<\/b> But it\u2019s not about a subgroup that says, \u201cOk, we want to do something else.\u201d<\/p><\/blockquote>\n

Another man admitted that, yes, as a scientist, he could see some issues with the methodology in some of the QS Show&Tell talks he\u2019d observed\u2014yet he remained adamant that rigorous scientific methodology wasn\u2019t the point. As he said,<\/p>\n

I think that the presentations that I\u2019ve heard in the last day and a half have been from people that had some medical issue, they went to the doctor, the doctors couldn\u2019t solve it, they gave up because they were so pissed off, and [they] tracked something, and then came back and told the story about how they discovered what was really wrong with them. And to sit in a room with a bunch of academics saying, \u201cOh, no, no, no, you gotta do the scientific process\u201d\u2014that failed to help the person<\/i>\u2014there\u2019s something fundamentally wrong with this conversation.<\/p><\/blockquote>\n

He went on to say that, yes, he\u2019d seen a number of Show&Tell presentations that seemed to be of \u201cquestionable statistical validity,\u201d but also that he\u2019d noticed the presenters \u201cstill found meaning and something from that.\u201d Referencing the Q&A portions of the QS Global 2013 plenaries, he said,<\/p>\n

Gary [Wolf\u2019s] questions every time are not about, \u201cHey, did you know you misinterpreted the p-value of this thing?\u201d They\u2019re about, \u201cDid you find tracking this changed your perception of how you did?\u201d It\u2019s so far removed from every scientific conference that I\u2019ve been to that the suggestion that we should actually have a scientific track is completely absurd [\u2026] It\u2019s very frustrating to sit in this room right now and hear the conversation that, \u201cThis isn\u2019t meeting my needs to meet my tenure track,\u201d when every single one of us has a professional organization to go present at.<\/p><\/blockquote>\n

That, of course, was the trick right there: This hadn\u2019t become a conversation about what Quantified Self wants, but about what one particular group of researchers wants from Quantified Self. And while some of those desires boiled down to a combination of ill-informed assumptions and epistemological superiority complexes, other desires to formalize QS were more self-interestedly pragmatic: the QS Conferences are insufficiently formal for most academic departments to provide travel funds (such funds are for \u201cdelivering papers\u201d at \u201cacademic\u201d conferences only), and there\u2019s not much about participating in a QS Conference that earns points with tenure committees. One woman had a slightly different problem: she had been observing the Quantified Self community for a while, and\u2014since her disciplinary convention mandates that she \u201cgive back\u201d to the populations she studies\u2014she wanted to do a presentation about her research. Yet every time she approached the organizers about doing a Show&Tell session, she was stymied by the Show&Tell format\u2019s requirement that she tell a personal story. She didn\u2019t have any personal stories, she just had research findings\u2014and as a result, was having a hard time finding a venue to tell QSers about themselves instead of telling them about herself[ii]<\/a>.<\/p>\n

\"photo<\/a>The larger pro-formalization camp did, however, raise some interesting points. One man talked about watching one particular Show&Tell presenter repeatedly answer the same detailed questions in informal conversation after his talk. Wouldn\u2019t it be better, he asked, if there was some kind of centralized repository where that man could put his detailed explanation\u2014in whatever format\u2014instead of having to explain the details of his project to every interested individual? Others pointed out that some QSers do want to do more rigorous statistical analysis, but didn\u2019t know how to do that. Shouldn\u2019t we help them? One man insisted, \u201cWe ARE part of the community,\u201d and made the case for treating researchers as a \u201cspecial needs population\u201d within Quantified Self\u2014especially because of the different ways researchers \u201cneed\u201d to communicate. (I enjoyed this comment for the subtle slight to academic jargon, though I don\u2019t know how many others in the room read it that way.)<\/p>\n

Still another pointed out that researchers have knowledge and skills that might be useful to the Quantified Self community, just like so many of the start-ups present were offering tools that might be useful to the Quantified Self community. Why weren\u2019t academic researchers being given the same amount of space and visibility? (No one pointed out that visibility is often a matter of sponsorship, not \u201cfairness.\u201d) While I don\u2019t think the academic community is entitled to anything from Quantified Self, this comment did highlight something I\u2019ve been thinking about a lot since. Quantified Self is growing rapidly, even \u201cblowing up\u201d (as the kids might say); \u201cquantified self,\u201d as a buzzword, has long since left the barn. And as both the hype and the enthusiasm swell, the scene surrounding Quantified Self is more and more looking like a feeding frenzy: tech sharks of all stripes circling, drunk on the scent of data; academics, unhappy with their lot as scavengers, trying to elbow their way to the table[iii]<\/a>.<\/p>\n

\"photo<\/a>Finally, I proposed the following: Back in my pre-grad-school non-profit life, I\u2019d worked at a harm-reduction based human services organization. All of our clients and participants belonged to at least one vulnerable population (if not several), and we were in it for the social justice, so the last thing we wanted to do was come in with a top-down approach and tell our clients and participants what kind of help they needed. Instead, we did needs assessment surveys<\/i>\u2014studies that asked our clients and participants what kind of help they needed and wanted\u2014and used the results of those studies to plan our programs. What if the research community did a \u201cneeds assessment survey\u201d QS-style, in the form of an experiment? What if we did something akin to the QS Conference \u201coffice hours,\u201d and sprinkled researchers across a bunch of small tables, and had each person provide a short description of what skills they were offering, and then compared notes after to see which questions had been most common and which sorts of assistance were most in demand? This way we could organize to offer (as volunteers) services and skills that non-researchers in the Quantified Self community are actually interested in, rather than try to implement by force some pre-fabricated notion of what (some) researchers think Quantified Self should be. Someone in the group helpfully named this hypothetical event \u201cSpeed Date a Scientist\u201d (which I love), and the idea seemed to go over well. Someone else suggested adding “Speed Date a Data Visualizer” and “Speed Date an Artist” as well (which I also love).<\/p>\n

While I\u2019m sure offering scientist speed-dates at QS Global 2014 wouldn\u2019t go far enough for the Formalize QS camp, perhaps it\u2019s a step in a sufficiently similar direction for some of those researchers to want to participate; it would also be a step taken in a way that would be less likely to \u201cprovoke an immunological response\u201d from the rest of the Quantified Self community (see also: make the social scientists\u2019 collective skin crawl). After all, what less than half the room seemed to realize was that\u2014subjective entitlement to power notwithstanding\u2014researchers don\u2019t have control<\/i> within Quantified Self. Researchers don\u2019t have the authority, either as conference organizers (who ultimately determine what the QS Conferences will and will not include) or as \u201cexperts.\u201d Quantified Self is about peer-to-peer knowledge transmission, not \u201cexpertise\u201d\u2014and while it might be funny (\u201cfunny\u201d) to watch a bunch of academic\/institutional researchers try to pull rank in a community based on an entirely different epistemic framework, I\u2019d kind of rather not see that happen. (Quantified Self specializes in \u201csoft resistance<\/a>\u201d [pdf], after all; I imagine the scene rather like watching an attacker (academia) rush at a t\u2019ai chi master (QS), only to end up in an embarrassing heap on the floor as the t\u2019ai chi master steps calmly aside.)<\/p>\n

\"photo<\/a>As Quantified Self grows, attracts more interest, and becomes a (somewhat) more diverse group, so too are the people interested in Quantified Self growing and becoming a (somewhat) more diverse group. This was not lost on the room; by the end of the session, we were wondering if \u201cQS researchers\u201d as a subgroup even made any sense. Some researchers wanted access to QSers\u2019 self-tracking data; some researchers wanted to study the gadgets and technologies; some researchers wanted to study the people and the practices. Some researchers identified as self-trackers, and some researchers did not; moreover, there was no consensus as to what the relationship between \u201cQS researchers\u201d and \u201cQuantified Self, broadly conceived\u201d should actually be. Perhaps there were things we researchers could learn from one another, but we also had what seemed to be some insurmountable intellectual differences. Some of us were offended by the lack of scientific rigor in some Quantified Self projects; others of us were offended by the insistence that \u201cscientific rigor\u201d was even necessarily relevant to Quantified Self. (As one social scientist said, \u201cI feel isolated, because I don\u2019t really identify as a positivist.\u201d)<\/p>\n

The 4:00 end time for the session came and went, and we were still talking. At 4:15, with half the break before the closing plenaries now past, I asked if anyone had any closing comments. The last remark came from a man who said,<\/p>\n

If I may, I do think that part of this conversation, or a role in this conversation, is a clash between old, conservative, academic thinking, and new, liberal, Quantified Self thinking. So just, maybe as a closure for ourselves, think about, ok, what has happened in the last hour during the conversation, and what was part of our own training as an academic, and what is possible for the future, to take with us?<\/p><\/blockquote>\n

This seemed (to me) to be a gentle way of asking his fellow academics to Check Your Assumptions\u2014and as a quiet murmur of agreement rolled around the room, it seemed that at least some of us had taken his words to heart. I\u2019m still not certain how \u201cQS researchers\u201d will organize, or how many different forms that organizing will take, or which of those forms will ultimately be \u201csuccessful\u201d (and as defined by whom). What I do know is that Quantified Self is a \u201csexy\u201d topic right now, which means there will undoubtedly be more and more of us\u2014and as that happens, it seems likely that \u201cQS researchers\u201d will undergo many (if not most) of the growing pains experienced by Quantified Self as a whole.<\/p>\n

 <\/p>\n

Whitney Erin Boesel is a sociology PhD student based in Cambridge, MA. She habitually livetweets her QS Conference experiences as @weboesel<\/a>\u2014except when she\u2019s presenting, because she\u2019s not quite that good. Yet.<\/em><\/p>\n

“QS researchers” session note images courtesy of the author.<\/em><\/p>\n

\n
\n
\n

[i]<\/a>\u00a0By comparison, my \u201cQS researchers\u201d breakout session at QS Global 2012 had 28 attendees, and the researchers\u2019 breakfast get-together at QS Europe 2013 had 23 attendees\u2014but while there were some familiar faces, more than half the attendees at this session were people I hadn\u2019t met before.<\/p>\n<\/div>\n

\n

[ii]<\/a> I should have asked her why she so badly wanted to do a Show&Tell session instead of a breakout session (which is a format based around a topic or an idea rather than a personal story). I\u2019ve done three breakout sessions now and, while I sometimes think that \u201cdon\u2019t speak for others\u201d thing leads me to use too many personal examples, I wouldn\u2019t exactly say that any of my breakout sessions have included personal stories, either. The only thing I can think of is that perhaps she wanted a plenary slot at one of the conferences (which would mean a bigger audience), and those are always Show&Tell format.<\/p>\n<\/div>\n

\n

[iii]<\/a> Yeah, fish don\u2019t have elbows. Whatever.<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

It\u2019s almost a week now since I attended the 2013 Quantified Self Global Conference in San Francisco, and I\u2019m still not sure where to begin with my summary of the event itself. Instead of jumping in with an overview, this time I\u2019ll cover my own session\u2014in which what started out as asking how researchers studying […]<\/p>\n","protected":false},"author":1875,"featured_media":17291,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[9967,892],"tags":[209,1598,4590,18415,26446,23041,16723,23045,431,18408],"class_list":["post-17284","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-commentary","category-essay","tag-academia","tag-community","tag-expertise","tag-gary-wolf","tag-qs","tag-qs13","tag-quantified-self","tag-quantrepreneurs","tag-research","tag-self-tracking"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/thesocietypages.org\/cyborgology\/files\/2013\/10\/photo-35.jpg","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/posts\/17284","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/users\/1875"}],"replies":[{"embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/comments?post=17284"}],"version-history":[{"count":12,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/posts\/17284\/revisions"}],"predecessor-version":[{"id":17304,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/posts\/17284\/revisions\/17304"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/media\/17291"}],"wp:attachment":[{"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/media?parent=17284"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/categories?post=17284"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thesocietypages.org\/cyborgology\/wp-json\/wp\/v2\/tags?post=17284"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}