Skip down to main content

How the Online Labour Index is constructed

Published on
18 Sep 2016
Written by
Otto Kässi

The Online Labour Index is an index that measures the utilization of online labour platforms over time and across countries and occupations.

Online labour platforms are here understood as platforms through which buyers and sellers of labour or services transact fully digitally. That is, we require that the worker and employer are matched digitally, the payment is conducted digitally via the platform, and that the result of the work is delivered digitally, excluding platforms for local services such as Uber and Airbnb. The index is based on tracking all projects and tasks posted into a selected sample of platforms, using API access and web scraping.

Which platforms are measured?

We currently limit our sample to the largest English language platforms as indicated by the unique monthly visitor estimate provided by Alexa.

To approximate the coverage of the OLI, we collected a list of 40 prominent English-language online labour platforms, retrieved their monthly estimated unique visitor counts from Alexa, and selected the top five. Using Alexa’s figures, we estimate that the platforms in our sample account for at least 60% of all traffic to English-language online labour platforms. They also represent a range of different market mechanisms and contracting styles, from online piecework to hourly freelancing.

Data collection

The data from which the OLI is calculated is collected by periodically crawling the list of vacancies available on each of the sample platforms. As in conventional labour markets, a vacancy refers to a job, project, or task offered by a firm that wishes to hire a worker. For each crawl, we save the status of each vacancy: open, in progress, or completed. Comparing changes in statuses allows us to calculate the number of new and filled vacancies between two crawls.

The main shortcoming of this approach is that we do not observe vacancies which were either posted and completed between two crawls, or which were completed without a vacancy being posted. The latter might happen if a vacancy is filled without it being posted on a platform. These hidden vacancies exist, and remain unmeasured, in traditional vacancy statistics as well. Notwithstanding these caveats, we believe that our measure fulfils its purpose of tracking the volume of work transacted on the platforms.

Besides vacancy status, we also collect the occupation classification and employer country for each vacancy, when available.

Normalisation

The Online Labour Index is calculated from the number of new vacancies on each day. 

As we are not tracking every single online labour market platform, and due to differences in details of data collection, it is not be possible to produce aggregates of absolute numbers; instead, the product is a set of indices that track changes over time in relation to the start of the data collection. In other words, we have normalised our time series so that the value in May of 2016 equals 100.

For more details on the insights provided by OLI, see here.

This post is a first post in a series of blog posts which discuss the methodology of the construction of the OLI. For details of how the OLI is constructed, see also How is online work classified on the OLI.

Related Topics:

Privacy Overview
Oxford Internet Institute

This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

Strictly Necessary Cookies
  • moove_gdrp_popup -  a cookie that saves your preferences for cookie settings. Without this cookie, the screen offering you cookie options will appear on every page you visit.

This cookie remains on your computer for 365 days, but you can adjust your preferences at any time by clicking on the "Cookie settings" link in the website footer.

Please note that if you visit the Oxford University website, any cookies you accept there will appear on our site here too, this being a subdomain. To control them, you must change your cookie preferences on the main University website.

Google Analytics

This website uses Google Tags and Google Analytics to collect anonymised information such as the number of visitors to the site, and the most popular pages. Keeping these cookies enabled helps the OII improve our website.

Enabling this option will allow cookies from:

  • Google Analytics - tracking visits to the ox.ac.uk and oii.ox.ac.uk domains

These cookies will remain on your website for 365 days, but you can edit your cookie preferences at any time via the "Cookie Settings" button in the website footer.