Abstract
When we invoke the “future of work,” to whose work do we refer? This paper considers everyday work practices through which contemporary artificial intelligence (AI) and machine learning (ML) ecosystems are made possible. The “future of work” is often talked about in relation to the anticipated domain settings where AI/ML systems might be implemented and the labor conditions such implementations might re-configure (foreseeing or noting changes in medical/health, legal, or manufacturing work, for example). This paper turns our attention to the various forms of labor that must be undertaken to conceive of, train/test, deploy, and ongoingly maintain AI/ML systems in practice. In particular, this paper draws on an ongoing ethnographic endeavor in a large, global technology and consulting corporation and leverages a work practices lens to examine three themes: curating datasets (everyday work practices of data pre-processing); tending models (everyday work practices of training, deploying, and maintaining predictive models); and configuring compute (everyday work practices of back-end infrastructuring, commonly called “DevOps”). This paper considers the value of a work practices lens in studying contemporary sociotechnical labor ecosystems. By locating the work practices through which AI/ML systems emerge, this paper shows that these technologies indeed require considerable human labor, at the same time they are often talked about as drivers of automation and displacers of work. This extends discourses around the “future of work,” giving light to the various standpoints and experiences of labor such imaginaries implicate and ongoingly re-configure.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
In an unsupervised approach, by contrast, the algorithmic modelling techniques take only input and devise their own outputs; unsupervised approaches are often used in exploratory data analysis.
- 2.
Agile stands in contrast to more traditional methods of organizing software engineering work, such as the Waterfall Method, where user requirements are gathered and analyzed at the beginning of a project (top of the Waterfall) before development efforts proceed. Once the project progress to the subsequent phase (i.e., moving from requirements analysis to development work) it does not revert back to prior phases (i.e., water falls in one direction).
References
Bechky, B.A.: Talking about machines, thick description, and knowledge work. Organ. Stud. 27(12), 1757–1768 (2006)
de la Bellacasa, M.P.: Matters of care in technoscience: assembling neglected things. Soc. Stud. Sci. 41(1), 85–106 (2011)
Bernstein, D.: Containers and cloud: from LXC to Docker to Kubernetes. IEEE Cloud Comput. 1(3), 81–84 (2014)
Burton, B.A., et al.: The reusable software library. IEEE Softw. 4(4), 25–33 (1987)
Carter, D., Sholler, D.: Data science on the ground: hype, criticism, and everyday work. J. Assoc. Inf. Sci. Technol. 67(10), 2309–2319 (2016)
Charmaz, K.: Constructing Grounded Theory: A Practical Guide Through Qualitative Analysis. SAGE, London (2006)
Cohen, D.: Agile Software Development. Super Star Press, California (2010)
Dahlbäck, N., et al.: Wizard of Oz studies: why and how. Knowl.-Based Syst. 6(4), 258–266 (1993)
Erich, F.M.A., et al.: A qualitative study of DevOps usage in practice. J. Softw. Evol. Process 29(6), 1885 (2017)
Faraj, S., et al.: Working and organizing in the age of the learning algorithm. Inf. Organ. 28(1), 62–70 (2018)
Goggins, S.P.: Collaboration in isolation: bridging social and geographical boundaries in two rural technology firms. In: IDEALS: iConference 2013 Proceedings (2013)
Gray, M.L., Suri, S.: Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass. Houghton Mifflin Harcourt, Massachusetts (2019)
Harding, S.: Rethinking standpoint epistemology: what is “strong objectivitiy?”. Centen. Rev. 36(3), 437–470 (1992)
Harding, S.: Whose Science? Whose Knowledge?: Thinking from Women’s Lives. Cornell University Press, New York (1991)
Holzinger, A.: Interactive machine learning for health informatics: when do we need the human-in-the-loop? Brain Inform. 3(2), 119–131 (2016)
Irani, L.C., Silberman, M.S.: Turkopticon: interrupting worker invisibility in Amazon mechanical turk. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 611–620. ACM, New York (2013)
Jarrahi, M.H.: Artificial intelligence and the future of work: human-AI symbiosis in organizational decision making. Bus. Horiz. 61(4), 577–586 (2018)
Karasti, H., Baker, K.S.: Infrastructuring for the long-term: ecological information management. In: Proceedings of the 37th Annual Hawaii International Conference on System Sciences, January 2004, pp. 1–10. IEEE, Honolulu, Hawaii (2004)
Kay, M., et al.: How good is 85%? A survey tool to connect classifier evaluation to acceptability of accuracy. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 347–356. ACM, New York (2015)
Kitchin, R., McArdle, G.: What makes big data, big data? Exploring the ontological characteristics of 26 datasets. Big Data Soc. 3(1) (2016)
Kling, R., Iacono, S.: The mobilization of support for computerization: the role of computerization movements. Soc. Probl. 35(3), 226–243 (1988)
Mell, P., Grance, T.: The NIST definition of cloud computing. Technical report #NIST Special Publication (SP) 800-145, National Institute of Standards and Technology (2011)
Orr, J.E.: Talking About Machines: an Ethnography of a Modern Job. Cornell University Press, New York (1996)
Paine, D., et al.: Examining data processing work as part of the scientific data lifecycle: comparing practices across four scientific research groups. In: IDEALS: iConference 2015 Proceedings (2015)
Pine, K.H., Wolf, C.T., Mazmanian, M.: The work of reuse: birth certificate data and healthcare accountability measurements. In: IDEALS: iConference 2016 Proceedings (2016)
Rankin, J.L.: A People’s History of Computing in the United States. Harvard University Press, Massachusetts (2018)
Sutherland, W., Jarrahi, M.H.: The sharing economy and digital platforms: a review and research agenda. Int. J. Inf. Manag. 43, 328–341 (2018)
Willis, M., Jarrahi, M.H.: Automating documentation: a critical perspective into the role of artificial intelligence in clinical documentation. In: Taylor, N.G., Christian-Lamb, C., Martin, Michelle H., Nardi, B. (eds.) iConference 2019. LNCS, vol. 11420, pp. 200–209. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-15742-5_19
Willis, M., Meyer, E.T.: Work that enables care: understanding tasks, automation, and the national health service. In: Chowdhury, G., McLeod, J., Gillet, V., Willett, P. (eds.) iConference 2018. LNCS, vol. 10766, pp. 544–549. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-78105-1_60
Wolf, C.T., Blomberg, J.L.: Evaluating the promise of human-algorithm collaborations in everyday work practices. In: Proceedings of ACM Computer-Supported Cooperative Work, pp. 143:1–143:23. ACM, New York (2019)
Wolf, C.T.: Conceptualizing care in the everyday work practices of machine learning developers. In: Companion Publication of the 2019 ACM Conference on Designing Interactive Systems Conference, pp. 331–335. ACM, New York (2019)
Wolf, C.T.: Professional identity and information use: on becoming a machine learning developer. In: Taylor, N.G., Christian-Lamb, C., Martin, M.H., Nardi, B. (eds.) iConference 2019. LNCS, vol. 11420, pp. 625–636. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-15742-5_59
Wolf, C.T.: Seeing work: constructing visions of work in and through data. In: Proceedings of the 19th ACM International Conference on Supporting Group Work, pp. 509–512. ACM, New York (2016)
Wolf, C.T.: The work of AI: sociotechnical contours of accessibility in contemporary software engineering. In: Proceedings of Applied Human Factors and Ergonomics (AHFE) 2020 Conference. Springer, Heidelberg (2020, to appear)
Acknowledgements
Thank you to informants and collaborators for sharing their time, insights, and points-of-view. All opinions are my own and do not reflect any institutional endorsement.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Wolf, C.T. (2020). AI Models and Their Worlds: Investigating Data-Driven, AI/ML Ecosystems Through a Work Practices Lens. In: Sundqvist, A., Berget, G., Nolin, J., Skjerdingstad, K. (eds) Sustainable Digital Communities. iConference 2020. Lecture Notes in Computer Science(), vol 12051. Springer, Cham. https://doi.org/10.1007/978-3-030-43687-2_55
Download citation
DOI: https://doi.org/10.1007/978-3-030-43687-2_55
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-43686-5
Online ISBN: 978-3-030-43687-2
eBook Packages: Computer ScienceComputer Science (R0)