I’m sooo glad to be in Berlin for the 6th edition of this beloved INDL-6 conference, which is taking place at Weizenbaum Institut!
INDL started as a small-scale, informal, little-funded project, aiming to create linkages between academics and students interested in the transformations of labour brought about by digital technologies. We first met in Paris in Spring 2017, then in Louvain-la-Neuve (Belgium) a few months later, and in both cases, a smallish 20-people room was enough for all. Back then, we called ourselves ENDL (where E stood for “European”).
But in 2019, we partnered with Toronto-based colleagues and upgraded to INDL, moving from European to International level. We started a cycle of conferences which initially remained rather small-scaled, and for two years had to take place online owing to the pandemic crisis. Things started to change in 2022, when colleagues from Greece proposed to restart an in-person version of the conference which eventually took place in Athens. It was also the first time that we launched a call for papers, rather than just limiting ourselves to invited speakers, and the conference was a huge success, with almost a hundred participants and sessions running in parallel.
This year edition’s follows the same format, and I’m so happy to see that a large community is forming around this topic. It’s good to see some people who already attended last year or even before, together with many new faces, and numbers continuing to grow (this year, we have three instead of just two parallel sessions!).
Together with the parallel sessions, this year’s event includes three keynotes, an arts-meets-science session, and a regulation-oriented debate on due diligence processes and the technology supply chain. Weizenbaum Institut is a wonderful place and has made available funding, support, and an incredibly committed team of colleagues, students, and volunteers who are making this conference a success.
For the programme, link to the livestreaming of plenaries and main sessions, and further information, please see indl.network.
Most of my current research aims to unpack artificial intelligence (AI) from the viewpoint of its commercial production, looking in particular at the human resources needed to prepare the data it needs – whence my studies on the data work and annotation market. However, for once, I am focusing on AI as a set of scientific theories and tools, regardless of their market positioning; indeed, I have joined a team of science-of-science specialists to study the disciplinary origins and subsequent spread of AI over time.
In a newly published, open-acces article, we unveil the disciplinary composition of AI, and the links between its various sub-fields. We question a common distinction between ‘native’ and ‘applicative’ disciplines, whereby only the former (typically confined to statistics, mathematics, and computer science) produce foundational algorithms and theorems for AI. In fact, we find that the origins of the field are rather multi-disciplinary and benefit, among others, from insights from cognitive science, psychology, and philosophy. These intersecting contributions were most evident in the historical practices commonly known as ‘symbolic systems’. Later, different scientific fields have become, in turn, the central originating domains and applicators of AI knowledge, for example operations research, which was for a long time one of the core actors of AI applications related to expert systems.
While the notion of statistics, mathematics and computer science as native disciplines has become more relevant in recent times, the spread of AI throughout the scientific ecosystem is uneven. In particular, only a small number of AI tools, such as dimensionality reduction techniques, are widely adopted (for example, variants of these techniques have been in use in sociology for decades). But if transfer of AI is largely ascribable to multi-disciplinary interactions, very few of them exist. We observe very limited collaborations between researchers in disciplines that create AI and researchers in disciplines that only (or mainly) apply AI. The small core of multi-disciplinary champions who interact with both sides, and the presence of a few multi-disciplinary journals, sustains the whole system.
Inter- and multi-disciplinary interactions are essential for AI to thrive and to adequately support scientific research in all fields, but disciplinary boundaries are notoriously hard to break. Strategies to better reward inter-disciplinary training, publications, and careers, are thus essential. Of course the potential for AI to significantly advance knowledge is still (largely) to be proven, and there have been disappointing experiences with, for example, the comparatively limited effectiveness of these tools in research on Covid-19. In all cases, the status quo is not ideal, and important steps forward are now needed.
We establish these results by analyzing a large corpus of scientific papers published between 1970 and 2017, extracted from Microsoft Academic Graph through the AI keywords used by the authors, and explored with different relational structures among the scientometric data (keyword co-occurrence network, authors’ collaboration network).
Full citation: Floriana Gargiulo, Sylvain Fontaine, Michel Dubois, Paola Tubaro. A meso-scale cartography of the AI ecosystem. Quantitative Science Studies, 2023; doi: https://doi.org/10.1162/qss_a_00267
What shapes differences in how people get paid, are deemed productive, or receive respect? Alongside traditional explanations of social inequalities such as class, gender, age, disability, race, migration status, rural vs. urban residence, and others, a recent literature highlights the effects of digital divides. The digitally resourced have more opportunities across all life spheres, from consumption to education, work, and health. Ironically, though, digital technologies also generate new vulnerabilities by generalizing low-paid and contingent work. Digital labour platforms like Uber, Deliveroo and Upwork use data and algorithms to match clients with workers, construed as independent contractors, for one-off ‘gigs’ without any long-term commitment. These workers are largely exposed to the vagaries of the market and have limited or no social protection, although increasing efforts aim to bring labour law to bear on platforms.
Growing concerns that platform workers compare unfavourably to conventional employees have already attracted significant research and policy attention. But more remains to be done to fully understand how the recent rise of labour platforms has undermined the relationship between digitization and inequalities, adding a layer of complexity. Scattered, but growing evidence indeed suggests that platforms may be accelerating transmission to digital worlds of ’legacy’ inequalities for example vis-à-vis race and gender, while also fostering the proliferation of ’emerging’ inequalities that diminish users’ agency and augment the power of technology creators and big-tech multinationals. Especially platforms for remote online-only labour change the geographical scale at which these questions arise, projecting workers toward a competitive planetary market that relentlessly selects winners and losers.
To tackle these questions, I’m happy and honoured to announce that I have just been awarded a major grant (almost 570k euros, at marginal cost) by the French National Agency for Research (ANR) for a new 4-year study called VOLI: Voices from Online Labour. As a team effort that builds on a solid record of interdisciplinary collaborations, VOLI innovatively combines hypotheses and methods from sociology and neighbouring disciplines, notably large-scale corpus linguistics (I’ll explain why below), and relies on speech technology and artificial intelligence to tackle the rising economic risks that coalesce around the nexus between online platform labour, digitization, and social inequalities. The project leverages the power and potential of the very digital tools whose societal effects it studies, to develop an original and potentially transferable methodology.
The innovative idea that underpins the project is to tackle the problem through language, benefiting from recent advances in linguistics research and its capacity to recast methods and tools from artificial intelligence in a broad sense – including speech and language technology and machine learning techniques – to capture features and processes that used to escape its traditional methods. Despite the importance of linguistic tasks (such as translation, transcription, writing, and editing) in online labour platforms, linguistic methods have never been applied to the study of these workers before, and thus are best positioned to bring fresh insight. To this end, we have assembled a team composed of speech technology scientists, computational linguists specialized in multilingual and large-scale corpora analysis, and computational, digital, and labour sociologists. Expected results sustain our ambition to devise policy solutions to mitigate the effects of inequalities, and to support the individuals and groups that accumulate multiple sources of disadvantage.
To harness our previous research experience and ensure continuity, we focus on so-called ’micro-work’, the necessary but inconspicuous contribution of low-paid masses who annotate, tag, label, correct and sort data to fuel the digital economy, especially artificial intelligence. Because it is performed remotely and can be allocated to providers worldwide, micro-work differs from location-based platform ’gigs’ such as delivery and transport. It also differs from online-only jobs for freelancers, for example in computer programming and design, insofar as its extreme segmentation and standardization allow dispersing tasks to an undefined crowd instead of a selected individual (whence the alternative denomination of ’crowdwork’). Micro-tasks include, for example, recording one’s voice while reading aloud a sentence, labelling files, translating short bits of text, classifying contents in an image or webpage. They perform essential functions in the development of machine learning and artificial intelligence, from data generation and enrichment to quality controls of automated outputs. We give voice to these workers, often invisibilized by the automation narratives popular in the technology industry, in that we interview them about their lived experience, aspirations, motivations and perhaps regrets; and we rely on their voices as data for the simultaneous development of sociology, linguistics, and artificial intelligence (specifically, speech recognition) itself.
Indeed while bringing to the next level our sociological knowledge of the linkages between micro-work and digital inequalities, the methods that will be developed within this highly interdisciplinary project advance the study of the factors driving speech variation within the discipline of linguistics, augmenting language corpora with rich sets of metadata from sociological surveys, while also building and testing new and improved tools for automated transcription, with potential commercial applications.
I am the PI of the VOLI project which involves four research centres within France:
Today, I end my 3-month-and-half visit to Churchill College, University of Cambridge where I am a By-Fellow. It has been an amazingly enriching experience and I gratefully acknowledge financial support from the French Embassy in the United Kingdom. Colleges are special places where traditional elitism mixes with more modern tendencies toward openness and diversity. I think the great value of colleges rests in their deeply interdisciplinary culture – way beyond what one may find in university departments and research centres. In my short stay, I have had lots of mind-opening conversations with scholars from all domains (often while enjoying a nice meal together), always with the feeling that people listen and learn from each other rather than that sense of constant competition that I have often perceived when crossing disciplinary boundaries.
My by-fellowship would not have been possible without the support of Gina Neff and her colleagues at Minderoo Centre for Technology and Democracy who hosted me. They are doing extremely valuable work to rethink the social and environmental impact of technologies and to promote innovative and more sustainable ways forward. I was also honoured to collaborate with the team of Cambridge Digital Humanities, especially Anne Alexander who directs the Learning programme and invited me to give two sessions on social network analysis at the Social data School last June. Finally, I thank the director and the members of the CRASSH research centre (where Minderoo is based) who kindly welcomed me at their offices and gave me the opportunity to attend some of their recent events.
AI is not just a Silicon Valley dream. It relies among other things, on inputs from human workers who generate and annotate data for machine learning. They record their voice to augment speech datasets, transcribe receipts to provide examples to OCR software, tag objects in photographs to train computer vision algorithms, and so on. They also check algorithmic outputs, for example, by noting whether the outputs of a search engine meet users’ queries. Occasionally, they take the place of failing automation, for example when content moderation software is not subtle enough to distinguish whether some image or video is appropriate. AI producers outsource these so-called “micro-tasks” via international digital labor platforms, who often recruit workers in Global-South countries, where labor costs are lower. Pay is by piecework, without any no long-term commitment and without any social-security scheme or labor protection.
In a just-published report co-authored with Matheus Viana Braz and Antonio A. Casilli, as part of the research program DiPlab, we lifted the curtain on micro-workers in Brazil, a country with a huge, growing, and yet largely unexplored reservoir of AI workers.
We found among other things that:
Three out of five Brazilian data workers are women, while in most other previously-surveyed countries, women are a minority (one in three or less in ILO data).
9 reais (1.73 euros) per hour is the average amount earned on platforms.
There are at least 54 micro-working platforms operating in Brazil.
One third of Brazilian micro-workers have no other source of income, and depend on microworking platforms for subsistence.
Two out of five Brazilian data workers are (apart from this activity) unemployed, without professional activity, or in informality. In Brazil, platform microwork arises out of widespread unemployment and informalization of work.
Three out of five of data workers have completed undergraduate education, although they mostly do repetitive and unchallenging online data tasks, suggesting some form of skill mismatch.
The worst microtasks involve moderation of violent and pornographic contents on social media, as well as data training in tasks that workers may find uncomfortable or weird, such as taking pictures of dog poop in domestic environments to train data for “vacuuming robots”.
Workers’ main grievances are linked to uncertainty, lack of transparency, job insecurity, fatigue and lack of social interaction on platforms.
We examine the implications of the use of digital micro-working platforms for scientific research. Although these platforms offer ways to make a living or to earn extra income, micro-workers lack fundamental labour rights and ‘decent’ working conditions, especially in the Global South. We argue that scientific research currently fails to treat micro-workers in the same way as in-person human participants, producing de facto a double morality: one applied to people with rights acknowledged by states and international bodies (e.g. Helsinki Declaration), the other to ‘guest workers of digital autocracies’ who have almost no rights at all.
As part of a large, interdisciplinary European research project, we are seeking a motivated, open-minded student to join CNRS (specifically, the Centre for Research in Economics and Statistics, CREST) in Palaiseau, France, for three years.
The thesis aims to model the production and dissemination of ‘fake news’ in situations of uncertainty and socio-economic inequality. A rich sociological literature suggests that actors contextualise messages received and emitted as questions or answers, interpret them according to their recipients and senders, and assess their social acceptability within their own networks of relationships, taking into account their relative position. Building on this research, the goal is to identify the social processes underpinning misinformation-generating digital communications: collective identity, inequalities of status or authority, hierarchy of shared norms. This will enable interpreting the online social interactions through which actors collectively judge the (appropriate or inappropriate) quality of a message or information and then decide whether to relay or share it – and with whom. In particular, the thesis work will contribute to: 1/ drawing up a state of the art, mainly within sociology but open to the neighbouring disciplines which have also addressed these questions; 2/ illustrating and testing these theories through an empirical analysis of a digital database, mainly with quantitative methods, which may be enriched through a small complementary qualitative fieldwork; 3/ to contribute to the preparation of guidelines that help information professionals and policy-makers to detect the sources and modalities of emergence and propagation of misinformation.
The thesis will be done within the framework of the interdisciplinary project “AI-based-technologies for trustworthy solutions against disinformation” (AI4TRUST), funded by the European Union over the period 2023-2026, involving 17 partners (research institutions and media professionals) in 10 countries, and coordinated by Fondazione Bruno Kessler (Italy).
The AI4TRUST project aims to build a hybrid system, with advanced artificial intelligence solutions capable of cooperating with humans in the fight against disinformation. The new algorithms that will be developed in this framework, constantly checked and improved by human fact-checkers, will monitor multiple online social platforms in nearly real time, analysing text, audio, and visual contents in several languages. The resulting quantitative indicators, including infodemic risk, will be inspected under the lens of social and computational social sciences, to build the trustworthy elements required by media professionals.
The successful candidate will have the opportunity to join a group of highly motivated scientists and practitioners from across the continent; to participate in collaborations with other teams working on the project in an interdisciplinary framework; to attend regular meetings with the project’s principal Investigator, the scientists and experts involved, and public decision-makers; to present and publish research results in international conferences and journals.
The ideal candidate has a good background in quantitative sociology or in a STEM discipline (e.g., mathematics, statistics, computer science) with a strong interest in societal issues and challenges. A very good knowledge of English, an interdisciplinary approach and the ability to work in teams are essential.
Candidates should apply on the CNRS portal, where they will also find more details.
We are excited to announce the 6th Conference of the International Network on Digital Labor (INDL-6), scheduled to take place 9-11 October, 2023. The conference aims to bring together experts from various fields to discuss the latest research findings and share ideas on the topic of Digital Labor in the Wake of Pandemic Times. Following long-term technological trends as well as exogenous shocks, the field of digital labor is constantly expanding. This year’s INDL conference will be an excellent opportunity to exchange insights and perspectives, as well as a great way to make new friends among researchers, workers, policymakers, and practitioners who study the future of work, social justice, platforms, and artificial intelligence (AI).
The INDL-6 conference will be held in-person at the Weizenbaum Institute for the Networked Society in Berlin, Germany. It is co-organized by the International Labor Organization (ILO), the Digital Platform Labor (DiPLab) group, and Wissenschaftszentrum Berlin für Sozialforschung (WZB).
We encourage all interested researchers, post-graduate students, and practitioners to submit proposals that address aspects of digital labor, including but not limited to: gig economy, online labor, workplace surveillance, algorithmic management, AI-assisted recruiting, remote work, employee well-being, inequality, policy responses to Covid-19 crisis, regulation, organizing digital workers, gender and work, LGBTQ+ workers, intersectionality, disability, inclusion, AI, decolonial lens, informal labor markets, generative AI and work.
We welcome submissions that are interdisciplinary in nature and strongly encourage proposals by researchers and practitioners from the Global South across all topics.
The Call for Papers is available here and the deadline is 12 April.
Three to five dollars: that’s the answer. As simple as that. I am talking about the behind-the-curtain market for personal data that sustains machine learning technologies, specifically for the development of face recognition algorithms. To train their models, tech companies routinely buy selfies as well as pictures or videos of ID documents from little-paid micro-workers, mostly from lower-income countries such as Venezuela and the Philippines.
Josephine Lulamae of Algorithm Watch interviewed me for a comprehensive report on the matter. She shows how, in this globalized market, the rights of workers are hardly respected – both in terms of labour rights and of data protection provisions.
I saw many such cases in my research of the last two years, as I interviewed people in Venezuela who do micro-tasks on international digital platforms for a living. Their country is affected by a terrible economic and political crisis, with skyrocketing inflation, scarcity of even basic goods, and high emigration. Under these conditions, international platforms – that pay little, but in hard currency – have seen a massive inflow of Venezuelans since about 2017-18.
Some of the people I interviewed just could not afford to refuse a task paid five dollars – at a moment in which the monthly minimum wage of Venezuela was plummeting to as little as three dollars. They do tasks that workers in richer countries such as Germany and the USA refuse to do, according to Lulamae’s report. Still, even the Venezuelans did not always feel comfortable doing tasks that involved providing personal data such as photos of themselves. One man told me that before, in better conditions, he would not have done such a task. Another interviewee told me that in an online forum, there were discussions about someone who had accepted to upload some selfies and later found his face in an advertisement on some website, and had to fight hard to get it removed. I had no means to fact-check whether this story was true, but the very fact that it circulated among workers is a clear sign that they worry about these matters.
On these platforms that operate globally, personal data protection does not work very well. This does not mean that clients openly violate the law: for example, workers told me they had to sign consent forms, as prescribed in the European General Data Protection Regulation (GDPR). However, people who live outside of Europe are less familiar with this legislation (and sometimes, with data protection principles more generally), and some of my interviewees did not well understand consent forms. More importantly, they have few means to contact clients, who typically avoid revealing their full identity on micro-working platforms – and therefore, can hardly exert their rights under GDPR (right to access, to rectification, to erasure etc.).
The rights granted by GDPR are comprehensive, but do not include property rights. The European legislator did not create a framework in which personal data to be sold and bought, and rather opted for guaranteeing inalienable rights to each and every citizen. However, this market exists and is flourishing, to the extent that it is serving the development of state-of-the-art technologies. Its existence is problematic, like the ‘repugnant’ markets for, say, human organs or babies for adoption, where moral arguments effectively counter economic interest. It is a market that thrives on global inequalities, and reminds of the high price to pay for today’s technical progress.
Estoy muy emocionada y feliz de empezar un ciclo de charlas en Chile, principalmente en Santiago y Talca, con Antonio A. Casilli este mes de enero. Agradezco mucho a la Embajada de Francia en Chile, al Instituto Francés de Chile, y a la Fundación Teatro a Mil por esta oportunidad maravillosa. Gracias también a Juana Torres Cierpe y a Francisca Ortiz Ruiz por su ayuda en contactar con colegas, amigos y estudiantes de Chile.
Empezaremos por una charla titulada “Plataformas digitales, trabajo en línea y automatización tras la crisis sanitaria”, que tendrá lugar el día lunes 16 de enero a las 12:00 hrs en la sede de la CUT (1 oriente # 809, Talca). En esta charla presentaremos nuestras investigaciones sobre el fenómeno del micro-trabajo fuertemente precarizado que se desarrolla en las plataformas digitales. Agradezco mucho a la profesora Claudia Jordana Contreras y a la Escuela de Sociología de la Universidad Católica del Maule por la organización de este evento.
El martes 17 enero 2023, 11:00, hablaré de “Inteligencia artificial, transformaciones laborales y desigualdades: El trabajo de las mujeres en las plataformas digitales de ‘microtareas” en el Instituto de Sociología de la Universidad Católica y con el Quantitative and Computational Social Science Research Group. Gracias a Mauricio Bucca que ha organizado este evento. Estaremos en la Pontificia Universidad Católica de Chile, Campus San Joaquín.
El martes 17 por la tarde (a las 17:000 hrs), hablaré de “Ética de la inteligencia artificial y otros desafíos para la investigación sobre redes sociales” como parte de la Escuela de Verano del Centro de Investigación en Complejidad Social, Universidad del Desarrollo. Agradezco a Jorge Fábrega Lacoa y sus colegas para la organización.
El viernes 20 de enero 2023, a las 10:00 hrs, Antonio y yo hablaremos juntos de “El trabajo detrás de la inteligencia artificial y la automatización en América Latina” en un taller internacional organizado por la Universidad de Chile – con Pablo Pérez (gracias por la organización!) y Francisca Gutiérrez, sala 129, FASCO, Av. Ignacio Carrera Pinto 1045, Ñuñoa.
Sigue un evento organizado por el Instituto Francés, “La noche de las ideas”:
Data Big and Small 