14 December 2023
To Score Is to Decide
Can the act of assigning a score to someone constitute a decision? This, in essence, is the question the Court of Justice of the European Union (CJEU) had to answer in Case C-634/21. And the Court’s answer is yes, following in the footsteps of the Advocate General’s opinion on the case. Rendered on 7 December, this ruling was eagerly awaited as it was the first time the Court had the opportunity to interpret the notorious Article 22 of the General Data Protection Regulation (GDPR) prohibiting decisions “based solely on automated processing". Continue reading >>
0
05 October 2023
Automated Decision-Making and the Challenge of Implementing Existing Laws
Who loves the latest shiny thing? Children maybe? Depends on the kid. Cats and dogs perhaps? Again, probably depends. What about funders, publishers, and researchers? Now that is an easier question to answer. Whether in talks provided by the tax-exempt ‘cult of TED’, or in open letters calling for a moratorium, the attention digital technologies receive today is extensive, especially those that are labelled ‘artificial intelligence’. This noise comes with calls for a new ad hoc human right against being subject to automated decision-making (ADM). While there is merit in adopting new laws dedicated to so-called AI, the procedural mechanisms that can implement existing law require strengthening. The perceived need for new substantive rules to govern new technology is questionable at best, and distracting at worst. Here we would like to emphasise the importance of implementing existing law more effectively in order to better regulate ADM. Improving procedural capacities across the legal frameworks on data protection, non-discrimination, and human rights is imperative in this regard. Continue reading >>
0
25 July 2023
A Scandal on AI in Administration, Again
After the infamous Dutch benefits scandal, the Netherlands are yet again the scene of wrongful application of an algorithm by the government. This time, the main actor is the Dienst Uitvoering Onderwijs (DUO), the Dutch agency responsible for the allocation and payment of student loans to those enrolled in Dutch higher education. Specifically, DUO used an algorithm in their enforcement task, namely to verify whether the student loans have been rightfully allocated. In 2012, DUO commenced the use of this ‘in-house’ algorithm, which the Minister of Education – under whose responsibility DUO falls – halted on 23 June. The developments in the Netherlands epitomize the promises and pitfalls of further integrating automated decision-making (ADM) into public administration. On the one hand, ADM – sometimes labelled ‘artificial intelligence’ – is cheap and promises efficiency gains. On the other hand, ADM systems may be error-prone when facing the complex realities of societal life and legal ambiguity. Continue reading >>
0