F1Verified
A court has struck down welfare fraud-detection legislation on human-rights grounds.
In its judgment of 5 February 2020 (ECLI:NL:RBDHA:2020:1878, case C/09/550982 HA ZA 18-388) The Hague District Court declared that Section 65 of the SUWI Act and Chapter 5a of the SUWI Decree, which governed the Systeem Risico Indicatie (SyRI), have no binding effect, being contrary to Article 8(2) ECHR.
F2Verified
The reason given was transparency and verifiability, not the use of data as such.
The court held that the legislation did not strike the fair balance Article 8(2) requires between combating fraud in the interest of economic welfare and the interference with private life, because the application of SyRI is insufficiently transparent and verifiable. It reasoned with reference to the Union-law principles of transparency, purpose limitation and data minimisation, and said the State bears a special responsibility when applying new technologies.
F3Verified
The UN Special Rapporteur on extreme poverty reported to the General Assembly on automated benefit systems and their failures.
Report A/74/493, transmitted 11 October 2019, describes the emergence of the 'digital welfare state' and warns of the risk of a digital welfare dystopia. It records that the Special Rapporteur received information about system errors or failures affecting large numbers of beneficiaries, giving as examples Australia's automated debt-raising and recovery system, the United Kingdom's Real Time Information system and Canada's Social Assistance Management System.
F4Verified
EU law now places benefit-eligibility systems in its high-risk category.
Annex III, point 5(a) of Regulation (EU) 2024/1689 lists AI systems intended to be used by, or on behalf of, public authorities to evaluate eligibility for essential public assistance benefits and services, including healthcare, and to grant, reduce, revoke or reclaim them.
F5Verified
A person subject to such a decision has a right to an explanation under the same regulation.
Article 86(1) gives any affected person subject to a decision taken by a deployer on the basis of the output of an Annex III high-risk system — other than the systems in point 2 — which produces legal effects or similarly significantly affects them adversely, the right to obtain from the deployer clear and meaningful explanations of the role of the AI system in the decision-making procedure and the main elements of the decision taken.