The Data Revolution: Orwellian nightmare or boon to people power?

Written by David McNair, Director of Transparency at ONE.

‘Algorithmic regulation’ – a new term coined by Silicon Valley tech pioneer Timothy O’Reilly – is an equally fascinating and terrifying notion.

O’Reilly, (who also coined the term ‘Web 2.0’) describes the way in which the so-called ‘internet of things’ – the web of connections between smart phones, cars, computers and fridges – constantly assimilates new information to amend rules for optimal outcomes. This, he suggests, could eventually extend to governance. Taken to the extreme, algorithms could use constant real-time feedback to make decisions about the allocation of resources without the need for the state-citizen interactions.  Foreign Policy highlights Singapore as perhaps the first case study of this kind of approach in action.

That this is now possible, signals a data revolution is happening. But for those interested in the implications for human development, a data revolution must mean more. It requires concrete investments in official statistics, the development of norms and standards to ensure new forms of data collection are managed responsibly, and the disclosure of information that can empower citizens to make their own decisions.

With this in mind, a group of experts from statistical authorities, multilateral agencies, tech firms and NGOs met in London in July to discuss how we harness the political energy around the data revolution to ensure some concrete improvements in data, accountability and ultimately outcomes for the world’s poorest people.

The group concluded in its outcome document that what is required is both evolution and revolution.

The increasing volumes of information make official statistics even more relevant; we will need benchmarks against which we can evaluate the quality of data sources and technical standards that allow cross-referencing and nuanced interpretations of changes in official statistics. Yet a survey of the capacity and independence of official statistical agencies in many developing countries makes for sobering reading.

An evolution in the expansion and investment in best practice, in the frequency of data collection, the ability of survey data to relate to official statistics is critical.

But we also need to harness the power of innovation – capturing the revolution in technology that will put information directly into the hands of millions of people – while enabling the collection of billions of data points in real-time – allowing for more effective monitoring and planning.

Harnessing these benefits requires investments now. For those of us who think about advocacy, we know that political will to do something about technical issues comes rarely, and leaves quickly. The negotiation of the Sustainable Development Goals (SDGs) and the need for data to monitor progress towards them provides such a window.

So what should we do about it? I think this means agreeing on a high level moment that can convene Heads of State, business leaders, NGOs and donors behind an action plan – let’s call it a data compact [h/t Amanda Glassman].

This event, and the commitments flowing from it, would raise the profile of data in decision making processes and secure new financial investments for improving official statistics, but would also encourage adherence to common technical standards and ethics in the collection, ownership and use of data from the myriad of actors who will are fast becoming the future information creators and consumers. We would love to see:

– Donors agree to invest in a new fund that encourages innovative practices from both small businesses and government bodies.

– Big firms and governments agree to a new code of practice on the collection and disclosure of personal information.

– Governments commit to making their statistical agencies politically independent and non-partisan, removing systemic biases in administrative data systems.

– NGOs and journalists commit to interpreting this information in a way that allows citizens to hold governments and businesses to account.

If this moment were to occur on World Population Day (11th July 2015), it would ensure that the right kinds of investments are being made to track the new Sustainable Development Goals that will be announced formally two months later.

But beyond this, it would also send the right signals that these goals are not simply aspirational words emerging from UN diplomats, but that they can form a ‘dashboard’ for any citizen to track the progress of their government against globally agreed commitments.

If this were to become a reality, the data revolution, more than being a threat to the state-citizen relationship, could oil the wheels of citizen accountability, improving service delivery, the efficient use of resources, and ultimately human development outcomes.

But to take advantage of this rapidly closing window of opportunity, we need a well-equipped group of champions who can advocate for these changes in the lead up to the 2015 summit when the SDGs are announced.

If you’re interested in getting involved in these activities, please email

3 Comments on "The Data Revolution: Orwellian nightmare or boon to people power?"

  1. When working for PARIS21 (at OECD) I was one of the (very) few who championed NSDSs and a supportive more global strategy for the development of statistics (GSDS); to me the GSDS will be an outcome of both the Post-2015 development and the indispensable data revolution to support it.

    The blog content seams to reflect views of mainly non-national users of data, whether official statistics or less formalised quantitative information; this is right in a quality management perspective where users needs are an essential basis to decide on improvement, by evolution or by revolution, and most likely by a mixture of both as it has always been the case for official statistics. It as already been suggested that International institutions producing official statistics adopt a common quality framework to assure their users of the quality of their outputs (most likely being consistent with the National Quality Assurance Framework

    However, what strikes me so far is the absence of reference to the work continuously done by countries in the UN system through the Statistical Commission, statistics working groups and the Committee for the Coordination of Statistical Activities, as if an attempt were made to replace the existing mechanisms lead by countries and set to deal worldwide with official statistics in a global perspective.

    Probably the main concern is who is in the driver seat; when it come to NSDSs PARIS21 partnership answer has been: the countries (and their democratic decision making processes). To me any GSDS has therefore to be commissioned, discussed and formerly validated by countries, most likely within the UN decision making process.

  2. A-1,FLAT NO-507,MODI BUILDERS,QUTUBULLAPUR,HYDERABAD,INDIA-PIN-500054 | August 17, 2014 at 4:59 am | Reply

    “Internet, inbuilt with,algorithms could be used constantantly to give real-time feedback, to make decisions about the allocation of resources without the need for the state-citizen interactions.” True,but take care of data collapse,wrong feed of mathemetics[statistics] and non linear inter connections of servers,could doom the world.
    A revolution we brought could be used to doom,but our aim is development,seggregation of information,and presentation as the need arises.There are others who need power,money,name and merchandise,so how data can be used for their purpose is also available.
    There is no way irreversable,and optimal solutions can be drawn to avoid carbon emissions,but there is a way how we can make new electric cars,and flying cabs for short distances.
    No way we could get power generation to match our needs,but the Dister proven atomic energy is readily available.
    Care,safety is also an essential part in data revolution,for a bright technological world,of the future.

    • Er.s.suryanarayana,A-1,FLAT NO-507,MODI BUILDERS,QUTUBULLAPUR,HYDERABAD,INDIA-PIN-500054 | August 19, 2014 at 1:25 pm | Reply

      The above comment belongs to me,i am a charted engineer,worked in several countries,in Infrastructre planning,design and construction.I am a member of several forums,and submitted several papers.I live 3 months in year in USA,PHONEIX,

Leave a comment

Your email address will not be published.