Tag Archives: Digital platforms

Brazil in the global AI supply chains: the role of micro-workers

AI is not just a Silicon Valley dream. It relies among other things, on inputs from human workers who generate and annotate data for machine learning. They record their voice to augment speech datasets, transcribe receipts to provide examples to OCR software, tag objects in photographs to train computer vision algorithms, and so on. They also check algorithmic outputs, for example, by noting whether the outputs of a search engine meet users’ queries. Occasionally, they take the place of failing automation, for example when content moderation software is not subtle enough to distinguish whether some image or video is appropriate. AI producers outsource these so-called “micro-tasks” via international digital labor platforms, who often recruit workers in Global-South countries, where labor costs are lower. Pay is by piecework, without any no long-term commitment and without any social-security scheme or labor protection.

In a just-published report co-authored with Matheus Viana Braz and Antonio A. Casilli, as part of the research program DiPlab, we lifted the curtain on micro-workers in Brazil, a country with a huge, growing, and yet largely unexplored reservoir of AI workers.

We found among other things that:

  • Three out of five Brazilian data workers are women, while in most other previously-surveyed countries, women are a minority (one in three or less in ILO data).
  • 9 reais (1.73 euros) per hour is the average amount earned on platforms.
  • There are at least 54 micro-working platforms operating in Brazil.
  • One third of Brazilian micro-workers have no other source of income, and depend on microworking platforms for subsistence.
  • Two out of five Brazilian data workers are (apart from this activity) unemployed, without professional activity, or in informality. In Brazil, platform microwork arises out of widespread unemployment and informalization of work.
  • Three out of five of data workers have completed undergraduate education, although they mostly do repetitive and unchallenging online data tasks, suggesting some form of skill mismatch.
  • The worst microtasks involve moderation of violent and pornographic contents on social media, as well as data training in tasks that workers may find uncomfortable or weird, such as taking pictures of dog poop in domestic environments to train data for “vacuuming robots”.
  • Workers’ main grievances are linked to uncertainty, lack of transparency, job insecurity, fatigue and lack of social interaction on platforms.

To read the report in English, click here.

To read the report in Portuguese, click here.

Research ethics in the age of digital platforms

I am thrilled to announce the (open access) publication of ‘Research ethics in the age of digital platforms‘ in Science and Engineering Ethics, co-authored with José Luis Molina, Antonio A. Casilli & Antonio Santos Ortega.


We examine the implications of the use of digital micro-working platforms for scientific research. Although these platforms offer ways to make a living or to earn extra income, micro-workers lack fundamental labour rights and ‘decent’ working conditions, especially in the Global South. We argue that scientific research currently fails to treat micro-workers in the same way as in-person human participants, producing de facto a double morality: one applied to people with rights acknowledged by states and international bodies (e.g. Helsinki Declaration), the other to ‘guest workers of digital autocracies’ who have almost no rights at all.

INDL-6 Conference: CfP now open

We are excited to announce the 6th Conference of the International
Network on Digital Labor (INDL-6), scheduled to take place 9-11 October, 2023. The conference aims to bring together experts from various
fields to discuss the latest research findings and share ideas on the
topic of Digital Labor in the Wake of Pandemic Times. Following
long-term technological trends as well as exogenous shocks, the field of
digital labor is constantly expanding. This year’s INDL conference will
be an excellent opportunity to exchange insights and perspectives, as
well as a great way to make new friends among researchers, workers,
policymakers, and practitioners who study the future of work, social
justice, platforms, and artificial intelligence (AI).

The INDL-6 conference will be held in-person at the Weizenbaum Institute
for the Networked Society in Berlin, Germany. It is co-organized by the
International Labor Organization (ILO), the Digital Platform Labor (DiPLab) group, and Wissenschaftszentrum Berlin für Sozialforschung (WZB).

We encourage all interested researchers, post-graduate students, and practitioners to submit proposals that address aspects of digital labor, including but not limited to: gig economy, online labor, workplace surveillance, algorithmic management, AI-assisted recruiting, remote work, employee well-being, inequality, policy responses to Covid-19 crisis, regulation, organizing digital workers, gender and work, LGBTQ+ workers, intersectionality, disability, inclusion, AI, decolonial lens, informal labor markets, generative AI and work.

We welcome submissions that are interdisciplinary in nature and strongly
encourage proposals by researchers and practitioners from the Global
South across all topics.

The Call for Papers is available here and the deadline is 12 April.

How much does a face cost?

Three to five dollars: that’s the answer. As simple as that. I am talking about the behind-the-curtain market for personal data that sustains machine learning technologies, specifically for the development of face recognition algorithms. To train their models, tech companies routinely buy selfies as well as pictures or videos of ID documents from little-paid micro-workers, mostly from lower-income countries such as Venezuela and the Philippines.

Josephine Lulamae of Algorithm Watch interviewed me for a comprehensive report on the matter. She shows how, in this globalized market, the rights of workers are hardly respected – both in terms of labour rights and of data protection provisions.

I saw many such cases in my research of the last two years, as I interviewed people in Venezuela who do micro-tasks on international digital platforms for a living. Their country is affected by a terrible economic and political crisis, with skyrocketing inflation, scarcity of even basic goods, and high emigration. Under these conditions, international platforms – that pay little, but in hard currency – have seen a massive inflow of Venezuelans since about 2017-18.

Some of the people I interviewed just could not afford to refuse a task paid five dollars – at a moment in which the monthly minimum wage of Venezuela was plummeting to as little as three dollars. They do tasks that workers in richer countries such as Germany and the USA refuse to do, according to Lulamae’s report. Still, even the Venezuelans did not always feel comfortable doing tasks that involved providing personal data such as photos of themselves. One man told me that before, in better conditions, he would not have done such a task. Another interviewee told me that in an online forum, there were discussions about someone who had accepted to upload some selfies and later found his face in an advertisement on some website, and had to fight hard to get it removed. I had no means to fact-check whether this story was true, but the very fact that it circulated among workers is a clear sign that they worry about these matters. 

On these platforms that operate globally, personal data protection does not work very well. This does not mean that clients openly violate the law: for example, workers told me they had to sign consent forms, as prescribed in the European General Data Protection Regulation (GDPR). However, people who live outside of Europe are less familiar with this legislation (and sometimes, with data protection principles more generally), and some of my interviewees did not well understand consent forms. More importantly, they have few means to contact clients, who typically avoid revealing their full identity on micro-working platforms – and therefore, can hardly exert their rights under GDPR (right to access, to rectification, to erasure etc.).

The rights granted by GDPR are comprehensive, but do not include property rights. The European legislator did not create a framework in which personal data to be sold and bought, and rather opted for guaranteeing inalienable rights to each and every citizen. However, this market exists and is flourishing, to the extent that it is serving the development of state-of-the-art technologies. Its existence is problematic, like the ‘repugnant’ markets for, say, human organs or babies for adoption, where moral arguments effectively counter economic interest. It is a market that thrives on global inequalities, and reminds of the high price to pay for today’s technical progress.

See the full report here.

A successful INDL-5 conference!

On 3-5 November 2022, I was at the department of Sociology of National and Kapodistrian University of Athens (NKUA) for the 5th INDL conference “Features and Futures of Digital Labor”. The conference was co-organized by us (the DiPLab project at the Polytechnic Institute of Paris) together with the International Labor Organization (ILO) and the Labor Institute of the General Confederation of Greek Workers.

The INDL (International Network on Digital Labor) project started as ENDL (the “E” standing for “European”) 5 years ago with an inaugural meeting in Paris. Since then, it has expanded internationally, and its members organized larger conferences in Paris (2019), Toronto (2019), Milan (2020, online), and Edinburgh (2021, online). INDL’s conference in Athens was the first in-person meeting since the beginning of the Covid-19 pandemic.

The key idea behind the creation of INDL, and the organization of these conferences, is that digital labor is central to the digital transformation of society. Despite its pervasiveness, though, the ways it is inscribed in the current organization of production and the state remain elusive. Different fields of the social and economic sciences, political theory, law, and philosophy have attempted to capture its distinctive attributes. The group’s initiatives contribute to this conversation by mapping the new working environments and fostering dialogue around the nature of digital work and the possible futures that academic research may help bring about.

Artificial Intelligence and Globalization: Data Labor  and Linguistic Specificities (AIGLe)

We organized the one-day conference AIGLe on 27 October 2022 to present the outcomes of interdisciplinary research conducted by our DiPLab teams in French-speaking African countries (ANR HuSh Project) and Spanish-speaking countries in Latin America (CNRS-MSH TrIA Project). Both initiatives study the human labor necessary to generate and annotate the data needed to produce artificial intelligence, to check outputs, and to intervene in real time when algorithms fail. Researchers from economics, sociology, computer science, and linguistics shared exciting new results and discussed them with the audience.

AIGLe is part of the project HUSh (The HUman Supply cHain behind smart technologies, 2020-2024), funded by ANR, and the research project TRIA (The Work of Artificial Intelligence, 2020-2022), co-financed by the CNRS and the MSH Paris Saclay. This event, under the aegis of the Institut Mines-Télécom, was organized by the DiPLab team with support of ANR, MSH Paris-Saclay and the Ministry of Economy and Finance.

PROGRAM
9:00 – 9:15 Welcome session

9:15 – 10:40 – Session 1 – Maxime Cornet & Clément Le Ludec (IP Paris, ANR HUSH Project): Unraveling the AI Production Process: How French Startups Externalise Data Work to Madagascar. Discussant: Mohammad Amir
Anwar (U. of Edinburgh)

10:45 – 11:00 Coffee Break

11:00 – 12:30 – Session 2 – Chiara Belletti and Ulrich Laitenberger (IP Paris, ANR HUSH Project): Worker Engagement and AI Work on Online Labor Markets. Discussant: Simone Vannuccini (U. of Sussex)

12:30 – 13:30 Lunch Break

13:30 – 15:00 Session 3 – Juana-Luisa Torre-Cierpe (IP Paris, TRIA Project) & Paola Tubaro (CNRS, TRIA Project): Uninvited Protagonists: Venezuelan Platform Workers in the Global Digital Economy. Discussant:
Maria de los Milagros Miceli (Weizenbaum Institut)

15:15 – 15:30 Coffee Break

15:30 – 17:00 Session 4 – Ioana Vasilescu (CNRS, LISN, TRIA Project), Yaru Wu (U. of Caen, TRIA Project) & Lori Lamel (LISN CNRS): Socioeconomic profiles embedded in speech : modeling linguistic variation in
micro-workers interviews. Discussant: Chloé Clavel (Télécom Paris, IP Paris)

Learners in the loop: hidden human skills in machine intelligence

I am glad to announce the publication of a new article in a special issue of the journal Sociologia del lavoro, dedicated to digital labour.

Today’s artificial intelligence, largely based on data-intensive machine learning algorithms, relies heavily on the digital labour of invisibilized and precarized humans-in-the-loop who perform multiple functions of data preparation, verification of results, and even impersonation when algorithms fail. This form of work contributes to the erosion of the salary institution in multiple ways. One is commodification of labour, with very little shielding from market fluctuations via regulative institutions, exclusion from organizational resources through outsourcing, and transfer of social reproduction costs to local communities to reduce work-related risks. Another is heteromation, the extraction of economic value from low-cost labour in computer-mediated networks, as a new logic of capital accumulation. Heteromation occurs as platforms’ technical infrastructures handle worker management problems as if they were computational problems, thereby concealing the employment nature of the relationship, and ultimately disguising human presence. My just-published paper highlights a third channel through which the salary institution is threatened, namely misrecognition of micro-workers’ skills, competencies and learning. Broadly speaking, salary can be seen as the framework within which the employment relationship is negotiated and resources are allocated, balancing the claims of workers and employers. In general, the most basic claims revolve around skill, and in today’s ‘society of performance’ where value is increasingly extracted from intangible resources and competencies, unskilled workers are substitutable and therefore highly vulnerable. In human-in-the-loop data annotation, tight breakdown of tasks, algorithmic control, and arm’s-length transactions obfuscate the competence of workers and discursively undermine their deservingness, shifting power away from them and voiding the equilibrating role of the salary institution.

Following Honneth, I define misrecognition as the attitudes and practices that result in people not receiving due acknowledgement for their value and contribution to society, in this case in terms of their education, skills, and skill development. Platform organization construes work as having little value, and creates disincentives for micro-workers to engage in more complex tasks, weakening their status and their capacity to be perceived as competent. Misrecognition is endemic in these settings and undermines workers’ potential for self-realization, negotiation and professional development.

My argument is based on original empirical data from a mixed-method survey of human-in-the-loop workers in two previously under-researched settings, namely Spain and Spanish-speaking Latin America.

An openly accessible version of the paper is available from the HAL repository.

Hidden inequalities: the gendered labour of women on micro-tasking platforms

Around the world, myriad workers perform data tasks on online labour platforms to fuel the digital economy. Mostly short, repetitive and little paid, these so-called ‘micro-tasks’ include for example labelling objects in images, classifying tweets, recording utterances, and transcribing audio files – notably to satisfy the data appetite of today’s fast-growing artificial intelligence industry. While casualization of labour and low pay have attracted sharp criticisms against these platforms, they appear gender-blind and accessible even to people with basic skills. Women with care or household duties may particularly benefit from the time flexibility and the possibility to work from home that platforms offer. So, are these new labour arrangements gender equalizers after all?

In a new paper co-authored with Marion Coville, Clément Le Ludec and Antonio A. Casilli, we demonstrate that this new form of online labour fails to fill gender gaps, and may even exacerbate them. We proceed in three steps. First, we show that legacy inequalities in the professional and domestic spheres turn platform-mediated micro-tasking into a ‘third shift’ that adds to already heavy schedules. Both working fathers and working mothers experience it, but the structure of the other two shifts affects their experience. Looking at their time use, it turns out that men dedicate long and uninterrupted slots of time to each activity: their main job, their share of household duties, leisure and micro-work. They tend to do all micro-tasks in a row, usually at night after work or in the morning before starting. Instead, women have more fragmented schedules, and micro-work during short breaks, here and there, eating into their leisure time. This is one reason why they earn less on platforms: they have short slots of time available, so they cannot search for better-paid tasks, and just content themselves with whatever is available at that moment.

Time use of typical female (left) and male (right), micro-workers, both of whom have a main job in addition to platform micro-tasks, and dependent children.

Second, we submit that the human capital of male and female data workers differ, with women less likely to have received training in science and technology fields.

Highest educational qualification (left) and discipline of specialization (right) of men and women micro-workers. Data collected in France, 2018 (n = 908).

Third, their social capital differs: using a position generator instrument to capture workers’ access to the informational and support resources that may come from contacts with people in different occupations, we show that women have fewer ties to digital-related professionals who could provide them with knowledge and advice to successfully navigate the platform world.

Gender assortativity index for each occupation in the 48-item position generator that measures respondents’ social capital. Each panel represents respondents’ choices, ordered from lowest (negative) to highest (positive) degree of similarity. Top panel: female respondents, bottom panel: male respondents. The bars corresponding to digital and computing occupations are hatched.

Taken together, these factors leave women with fewer career prospects within a tech-driven workforce, and reproduce relegation of women to lower-level computing work as observed in the history of twentieth-century technology. 

The full paper is available in open access here.

It is part of a full special issue of Internet Policy Review on ‘The gender of the platform economy‘, guest-edited by M. Fuster Morell, R. Espelt and D. Megias.

Networks in the digital organization

This week, I was pleased and honoured to give a keynote speech at wonderful EUSN2021 (European Social Networks 2021) conference. The event was originally planned in beautiful Naples, but was unfortunately moved online because of pandemic-induced uncertainties.

In my talk, I endeavoured to reconcile the tradition of research on social and organizational network analysis – in which I have been trained, and which constitutes the specialism of most participants to EUSN conferences – with the nascent literature on digital platform labour. Indeed, organizational network studies have shaped my (and many other colleagues’) understanding of how social ties and structures drive collective action and shape its outcomes. However, contemporary computing technologies breed novel sociabilities and organizational modes that disrupt established practices and knowledge. In particular, the emergence of digital platforms as market intermediaries constitutes a puzzle for network researchers. These emerging organizational structures loosen individual-organization links, fragment production processes, individualize sub-contracting, extend competition beyond the local level, and threaten jobs with AI-fuelled automation. My question then is: in these environments where isolation dominates and collaboration fades, how do social networks operate, if at all? And how can we, as researchers, apprehend them?

In my talk, I discussed how digital platforms, and the transformations of work processes they trigger, challenge some of the key tenets of organizational network analysis. Yet there is still much to learn from this tradition, and the limited overlaps with the nascent literature on platforms reveal facets that neither of them, alone, could capture. This analysis also confirms that overall, technology-enabled platform intermediation restrains sociability and limits interactions, but specific cases where networking has been possible highlight the fundamental advantages it brings to workers.

On this basis, I outlined directions for future research and policy action.

Many thanks to the organizers who still did a wonderful job despite the online-only mode, and to all attendees for inspiring questions and feedback.