Current Projects
I study the temporal politics in and around computational media and artificial intelligence. As time punctuates how we manage, anticipate, and pace, the sociotechnical (re)configurations of our orientations to speed, rhythms, and futures reveal the power structures in which we operate — and shed light on how we can build and imagine futures otherwise.
Specifically, my research examines how speed manifests as the aspirations and telos of technology innovation — and the paradoxes this introduces. To this end, I scrutinize the failure-speed ethos of rapid prototyping, the frictions between immediacy and indeterminacy in real-time algorithmic processes, the tension between spreadability and expressivity in “short media” like TikTok, and the ambivalence of constant connectivity with the advent of mobile media. I use these cases to rethink the ethics of how fast — or slow — we may want our life to be, and how computational media could be reimagined beyond accelerationist logics.
I also interrogate why certain technological futures are valorized over others — and how we can dream of futures otherwise. Presently, I am tracing how generative AI is brought forth as a speculative project of the “acceleration of acceleration” through trend reporting, prototype demos, and regulatory sandboxes. Beyond the techno-optimist pursuits of technotopias, I also foreground alternative contours of technology innovation that can help us envision futures otherwise. For instance, how can we integrate the principles of agonistic pluralism into present-day responsible AI ecosystems?
From the rhythms of media culture to the timescales of future-making, my research foregrounds the ethico-political tensions between speeding up and slowing down, between speculation and anticipation, and between possibility and inevitability. In my work, I integrate analytic traditions from science and technology studies (STS), human-computer interaction (HCI), and media studies. Methodologically, I draw on genealogical, interpretive, ethnographic, and design-futuring approaches.
Previous Projects
Before my PhD, I have studied participatory approaches to AI design and development across a variety of contexts, from architectural design to clinical decision-making. I have also studied the appropriation of mobile media in underground dance music scenes and networked activism.
Mapping the Participatory Turn in AI Design
March 2021 - September 2023
Collaborator: Fernando Delgado, Michael Madaio, Qian Yang
Description:
Despite the growing consensus that stakeholders affected by AI systems should participate in their design, enormous variation and implicit disagreements exist among current approaches. For researchers and practitioners who are interested in taking a participatory approach to AI design and development, it remains challenging to assess the extent to which any participatory approach grants substantive agency to stakeholders.
Methods:
Stage 1 - Conceptual Framework: We first derive a conceptual framework through synthesis of literature across technology design, political theory, and the social sciences that researchers and practitioners can leverage to evaluate approaches to participation in AI design.
Stage 2 - Empirical Foundation: We then evaluated the current state of stakeholder participation in AI. We developed a corpus including 80 research publications that described AI projects in which stakeholder participation was pursued, as well as 12 interviews with researchers and industry practitioners who were authors on these papers.
Publication:
Fernando Delgado*,
Stephen Yang*, Michael Madaio
†, and Qian Yang
†. (2023). The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice. Paper accepted to the ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO'23). [
full paper]. [
video]. [
summary].
Fernando Delgado,
Stephen Yang, Michael Madaio, and Qian Yang. (2021). Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and Stir." Paper Presented at the Human-Centered AI Workshop at NeurIPS 2021. [
link].
* Co-first authors and co-last authors contributed equally.
When Design Workshops Meet Chatbot: Operationalizing Participatory Architectural Design
January 2022 - August 2022
Collaborator: Jonathan Dortheimer, Aaron Sprecher, Qian Yang
Description:
Today’s participatory design (PD) processes focus on face-to-face design workshops as the primary method of participation. However, their time- and resource-intensive nature poses practical constraints on the extent to which these workshops can amplify diverse voices. With the maturing capabilities of large language models (LMs) like GPT-3, chatbots present great promise as an emerging PD method that can distribute participation across geographic, resource, and language differences. To this end, we facilitated participatory architectural design project in northern Israel through a hybrid PD workflow that leveraged both (1) group-based, face-to-face design workshops and (2) one-on-one, remote, GPT-3-powered chatbot engagement. Our experience offers a valuable reference for future research that seeks to incorporate chatbots in PD processes or explore spatial-temporal possibilities of PD beyond traditional face-to-face workshops.
Publication:
Stephen Yang, Jonathan Dortheimer, Qian Yang, Aaron Sprecher. (2024). When Design Workshops Meet Chatbots: Meaningful Participation at Scale?. International Journal of Architectural Computing. [
link].
Jonathan Dortheimer,
Stephen Yang, Qian Yang, Aaron Sprecher. (2023). Conceptual Architectural Design at Scale: A Case Study of Community Participation Using Crowdsourcing.
Buildings,
13, 222. [
link].
Harnessing Biomedical Literature to Calibrate Clinicians' Trust in AI-Powered Decision Support Systems
January 2021 - January 2023
Collaborator: Yiran Zhao, Qian Yang, Yuexing Hao, Kexin Quan, Fei Wang, Volodymyr Kuleshov, Bojian Hou
Description:
Clinical decision support tools (DSTs), powered by Artificial Intelligence (AI), promise to improve clinicians' diagnosis and treatment decision-making. However, no AI model is always correct. DSTs must enable clinicians to validate each AI suggestion, convincing them to take correct suggestions while rejecting errors. Towards this goal, existing DST designs often explain AI's inner workings or performance indicators. We chose a different approach: We investigated how clinicians validated each other's suggestions in practice.
Methods:
As a first step, we conducted 12 interview with clinicians to investigate how clinicians sought, prioritized, and synthesized information from the literature to validate care suggestions. We paid particular attention to whether and how clinicians' behaviors deviated from best practices in the time pressure of patient care.
Prototype
Building on our insights, we designed a new DST that embraces clinicians' naturalistic evidence-calibration behaviors. The
web-based prototype can be accessed here. This design helps clinicians deliberate whether to take an AI's suggestion by providing a list of supporting and opposing evidence from biomedical literature.
Publication
Qian Yang, Yuexing Hao
*, Kexin Quan
*,
Stephen Yang*, Yiran Zhao
*, Volodymyr Kuleshov, and Fei Wang. Harnessing Biomedical Literature to Calibrate Clinicians’ Trust in AI Decision Support Systems. In Proceedings of the 2023 ACM Conference on Human Factors in Computing Systems (CHI’23). [
link].
* Co-second authors contributed equally listed in alphabetical order.
Playing with Visibility in Underground Electronic/Dance Music Scenes
March 2021 - January 2023
Description:
The mediation of mobile and social media has reshaped how people imagine, understand, and, in turn, negotiate the visibility of their self-expression, information sharing, and relationship-building. Prior work on visibility management has focused on the online circulation of content without attending to the spatial-temporal context of situated technology use. To investigate these dimensions of visibility management on and through mobile and social media, I examined how participants in underground electronic/dance music culture (EDMC) manage their visibility. This research examines how the mediation of mobile and social media has reshaped what participants of underground EDMC do to maintain their shared culture of secrecy.
Methods
I conducted 20 nights of field observations at live music events and 27 semi-structured interviews with scene participants. I adopted a multi-site approach by studying four underground dance music scenes in distinct socio-political contexts––New York City; Ithaca, New York; Taipei, Taiwan; Berlin, Germany. Taking a “field site as network” approach (Burrell, 2009), I selected the four music scenes as “entry points” to gain access to underground EDMC.
Publications:
Stephen Yang. (Accepted and forthcoming). Playing with Visibility: Underground Electronic/Dance Music in the Smartphone Age. International Journal of Communication.
#IChooseFish and the New Frontier of Civic Participation in Vietnam
Jan 2021 - May 2022
Collaborator: Emily La
Description:
In April, 2016, millions of dead, toxic fish washed up along the north-central Vietnamese coast. In the aftermath, the Vietnamese official gave a statement: “Choose fish or steel” to imply that Vietnam’s economic growth is not without some sacrifice to the environment. In response, the hashtag #IChooseFish became viral, through which the Vietnamese public shared information on upcoming protests and coordinated emergency relief for local residents. This project seeks to to understand the role of technologies for dissents in non-Western, authoritative contexts.
Methods:
We adopted a mixed-method approach to underpin how the use of hashtags and mobile media contributed to the discourse formation surrounding the #IChooseFish movement. On the quantitative side, we drew on computational analysis of Twitter data to examine hashtag co-occurrence patterns and the specific discourse that have developed from this practice. On the qualitative side, we drew on semi-structured interviews with protesters to attend to how they leverage hashtags and mobile social media for their participation in the protests.
Presentation:
Emily La, Stephen Yang (May, 2022). The Role of Hashtags and Mobile Media in Shaping Discourse During the #IChooseFish Environmental Movement. Presented 72nd annual meeting of the International Communication Association (ICA). Paris, France.
Documenting the Lived Experiences of Data Subjects
January 2020 - January 2021
Collaborator: Ranjit Singh, Amy Eng, Deana Gonzales, Ciarra Lee, Emma Li, Cassidy McGovern, Annika Pinch, Sterling Williams-Ceci, Kyra Wisniewski,, and Malte Ziewitz
Description:
Being ranked in web search engines can make or break or business, reputation, or career. Big companies and organizations may have the resources to hire PR and marketing consultants to affect their standing in the engines. But how do less well-resourced people make sense and cope with their predicament? Through a series of qualitative interviews, we collected the stories from small business owners and local activists to politicians running for public office and people re-entering society after prison terms.
Publication:
R. Singh, A., Eng, D. Gonzales, C. Lee, E. Li, C. McGovern, A. Pinch, S. Williams-Ceci, K., Wisniewski, S. Yang, and M. Ziewitz. (2020).
Scoring Struggles: Everyday Experiences of Web Search Engines. Working Paper #1, August. Ithaca, NY: Digital Due Process Clinic.
Design Projects
Flo: Designing Mood-Aware Space for Co-Listening
January 2021 - May 2021
Collaborator: Tony Bridges, Emma Wang, Laurel Prime
Description:
Existing solutions for music co-listening, the act of listening to music together synchronously, has neglected the particular social and emotional needs of people with anxiety and/or depressive disorders. To bridge the gap in the design space, this project seeks to address such needs with a design for co-listening. Our research and design process attempts to valorize the thoughts, experiences, and feelings of this underserved population.
Through semi-structured interviews, diary study, and a co-design workshop, we found that the moods of our users are strongly influenced by the music they listen to, and often feel a lack of control over the emotional dimension of their co-listening experience. This makes it challenging for them to pursue social connectedness through music co-listening. Based on such insights, we designed Flo, a music-oriented virtual space that offers mood-based curations for co-listening to foster music-led sociality through emotional sensibility.
Prototype:
We have developed a
high-fidelity prototype of Flo on Figma and a
written report that walks through the design process.
Lively: Performance Streaming for Amateur Musicians
September 2020 - December 2020
Collaborator: Donna Ilyukh, Danni Ji, Kepler Despinos
Description:
This project investigates the needs of the needs of amateur, independent, up-and-coming musicians that are unable to perform at physical venues during the pandemic. Through semi-structured interviews, card sorting , and affinity diagramming, we developed Lively, a streaming platform that allows such musicians to stream their performances on their own. Our design highlights two key dimensions of their needs - (1) the needs for hassle-free control over the technical aspects of performance and (2) the needs to engage with their audience throughout the performance.
Prototype:
We have developed a
high-fidelity prototype of Lively on Figma and a
written report that walks through the design process.