Algorithmic Transformation and Diffusion of Power: Trust, Conflict, Uncertainty and Control

Prof. Dr. Indra Spiecker gen. Döhmann LL.M.; Prof. Dr. Christoph Burchard LL.M. (NYU)

doi:10.5771/9783748929093

Summary

Algorithmic systems and artificial intelligence, as manifestations of digitization, are increasingly permeating more and more areas of modern lives. This volume brings together interdisciplinary contributions from leading international experts on current issues concerning the transformation of established normative orders into a predictive society, how algorithmic normativity challenges trust and control as central concepts of legal governance, creates uncertainty, influences political processes, changes power and order in democracies, and leads to the diffusion of power. Last but not least, it examines the extent to which its use requires democratic participation and (co-)design when trust, control and normative binds are uncertain..

Keywords

Search publication

Bibliographic data

Copyright year: 2025
ISBN-Print: 978-3-8487-8548-3
ISBN-Online: 978-3-7489-2909-3
Publisher: Nomos, Baden-Baden
Language: English
Pages: 432
Product type: Edited Book

1. Titelei/Inhaltsverzeichnis Download chapter (PDF)
1. Burkhard Schäfer Download chapter (PDF)
  1. A. Introduction: The author wants to apologise for any inconvenience caused
  2. B. Better luck next time: the counterfactual approach to AI explanations
  3. C. “Everything is my fault, I'll take the blame”
  4. D. Those salty robot tears
  5. E. Robot-Love means never having to print 1001001001010
2. Jonathan Simon Download chapter (PDF)
  1. A. Introduction
  2. 1. Actuarial Justice: 1982-1994
    2. Eugenic Justice: 1905-1945
    3. Clinical justice: 1945-1980
  3. 1. From the Actuarial to the Algorithmic
  4. D. Conclusion
3. Katja Langenbucher Download chapter (PDF)
  1. A. Introduction
  2. 1. 1. 1. Disparate Treatment
      2. 2. Disparate Impact
      3. 3. Discriminatory credit underwriting
    2. II. The EU framework
  3. 1. I. The Metaphor of Building Blocks
    2. II. Building blocks and redundant encoding
    3. 1. 1. Causation, But-For Standard, and Proof
      2. 2. The challenge of producing a counterfactual
      3. 3. The challenge of gaining access to the AI
      4. 4. Hard Cases
  4. 1. The EU has stood out for active rulemaking where AI is concerned. Its AI Act stipulates a risk-based approach based on the legislator’s perception of especially risky AI use cases. AI-based credit scoring and creditworthiness evaluation count among these, Art. 6 para. 2 AI Act, Annex III Nr. 5b. Recital (58) AI Act explains why this is the case: These AI systems determine “access to financial resources or essential services”, they “may lead to discrimination (…) and may perpetuate historical patterns of discrimination (…) or may create new forms of discriminatory impacts”. The AI Act’s answer
    2. I. Art. 6’s unhelpful text/part 1: “do not discriminate (…) on ground of”
    3. II. Art. 6’s unhelpful text/part 2: “without prejudice to the possibility of offering different conditions (…) where (…) duly justified by objective criteria”
    4. III. The Consumer Credit Directive in the age of AI: Algorithms for inclusion?
  5. E. Take-aways
4. The functionality of data protection in a digitizing society –⁠ ⁠a⁠ ⁠systemic⁠ ⁠view⁠ ⁠of⁠ ⁠control⁠ ⁠and⁠ ⁠trustPages 91 - 98 Stefan Brink, Clarissa Henning Download chapter (PDF)
5. Lucia Zedner Download chapter (PDF)
  1. A. Introduction
  2. B. The place of algorithmic tools in the criminal justice system
  3. C. Algorithmic challenges to the responsible subject
  4. D. Fixing the future self
  5. E. Limits on the agency of criminal justice professionals
  6. F. RAIs and Regard for Individual Agency
  7. G. Conclusion
6. Frank Pasquale, Mathieu Kiriakos Download chapter (PDF)
  1. A. Introduction
  2. B. Normative and Practical Shortcomings of Scoring
  3. C. Normative and Practical Advantages of Narrative Accounts of Creditworthiness
  4. D. Addressing Objections
  5. E. The Intrinsic Case for Narrative Accounts of Creditworthiness
  6. F. Conclusion
7. Hadar Dancig-Rosenberg Download chapter (PDF)
  1. A. Introduction
  2. B. Al-driven Criminal Justice: A Cosmetic or a Real Regime Change?
  3. C. Trust, Legitimacy and Accountability
  4. D. Trust in an Era of Algorithms: A Look to the Future
1. Sabine Müller-Mall, Johannes Haaf Download chapter (PDF)
  1. A. Introduction
  2. B. Algorithms
  3. C. Algorithms and the Political Form of Society
  4. D. A New Legality of the Normal
  5. E. Three Challenges in Lieu of a Conclusion
2. Sofia Ranchordas Download chapter (PDF)
  1. A. Introduction
  2. 1. I. Administrative Law: Background Information
    2. II. Public Law and Gender
  3. 1. I. Gender Blindness
    2. II. Why women remain invisible
  4. 1. I. Gender Impact Assessments
    2. II. Data Feminism
    3. III. AI as Equalizer
  5. E. Conclusion
3. Beatrice Brunhöber, Bernhard Jakl Download chapter (PDF)
  1. 1. I. Adapting law to evolving realities
    2. II. Bans as recognized political instrument
    3. III. The relationship between trust and ban
    4. IV. Open questions
  2. 1. I. Bans in criminal law: Penalizing conduct in the context of innovations
    2. II. From ban to trust: Cultivating trust by pre-empting future risks associated with innovations
    3. III. Reassessing the relationship between trust and ban in criminal law regulation of innovations
  3. 1. I. The approach of EU institutions: creating trust in the digital world through bans
    2. II. Where to find normative experiences with ban in existing private law?
    3. III. Trust as starting point for private law
    4. IV. A comprehensive ban on social scoring?
  4. D. Conclusion
4. Martin Belov Download chapter (PDF)
  1. A. Introduction
  2. B. Uncertainty in the Digital Age: Constitutional Challenges and Repercussions
  3. C. Challenges to Trust produced by Algorithmic Transformations of Power
  4. D. Deconstitutionalization and de-democratization trough Globalization and Digitalization: towards a Global Algorithmic Technocracy and Dark Constitutionalism?
5. Michael Bäuerle Download chapter (PDF)
  1. A. Scope and delimitation
  2. 1. I. Expansion of the tasks of the security authorities and technological change
    2. II. Intensification of information-related legislation
    3. III. The Federal Constitutional Court as a permanent corrective
  3. 1. I. State handling of data as an encroachment on fundamental rights
    2. 1. 1. Differentiated fundamental rights protection of privacy as a starting point
      2. a) Sector-specific, sufficiently specific and sufficiently clear legal basis
        b) Proportionality of the enabling provision(s)
    3. 1. 1. Criteria for determining the intensity of intervention
      2. 2. Intervention intensity and need for regulation in the application of algorithm- or AI-controlled processes by the security authorities
  4. D. (No) diffusion of responsibility through algorithms under the conditions of the constitutionalization of the security authorities' informational powers
1. Tobias Singelnstein Download chapter (PDF)
  1. A. Starting points
  2. B. Artificial intelligence and social control
  3. 1. I. Risk identification
    2. II. Risk assessment
    3. III. Risk management
  4. 1. I. Disruptions to the security of the future
    2. II. Dealing with disruptions to the security of the future
  5. E. Conclusion
2. Automation and MercyPages 281 - 288 Kiel Brennan-Marquez Download chapter (PDF)
3. Tim Zander, Jürgen Beyerer Download chapter (PDF)
  1. A. Introduction
  2. 1. I. Attack-graph
    2. II. Risk in the attack graph
    3. III. Example: Multiple Stakeholders
    4. IV. Granularity of the attack graph
    5. V. Attack-fault trees
  3. C. Conclusion
4. Anna Beckers, Gunther Teubner Download chapter (PDF)
  1. A. Algorithms, Risks, and Regulation: A critique of the European AI Act
  2. B. Three socio-digital institutions and their risks
  3. 1. I. Socio-Digital Institution: Assistance
    2. II. Specific Risk: Autonomous algorithmic decision-making
    3. III. Responsibility attribution: Users/Operators
  4. 1. I. Socio-Digital Institution: Digital hybridity
    2. II. Specific Risk: indeterminable association of human and machine action
    3. III. Responsibility attribution: network
  5. 1. I. Socio-digital Institution: Exposure to interconnectivity
    2. II. Specific Risk: Interconnectivity
    3. III. Responsibility attribution: Socialising of risk
  6. F. Conclusion
1. Jörn Lamla Download chapter (PDF)
  1. A. Beyond strong and weak AI
  2. B. The digital analogism of the cybernetic cosmology
  3. C. Heterogeneous existence and AI in the hybrid life forms of democracy and privacy
2. Klaus Günther Download chapter (PDF)
  1. A. How is it possible to limit instrumental power of AI?
  2. B. The internal connection between norm, responsibility and deviant behavior
  3. 1. I. Techniques of risk minimization
    2. II. Compliance with norms - certainty or trust?
  4. D. AI as a new technology of self-commitment?
  5. E. The normative constitutionalization of smart orders as a way out?
3. Ingo Wolfgang Sarlet, Andressa de Bittencourt Siqueira Download chapter (PDF)
  1. A. Introduction
  2. B. The changing role of social media platforms
  3. 1. I. Regulatory scope and categorization
    2. 1. 1. Self-regulation
      2. 2. External regulation
      3. 3. Hybrid models of regulation
  4. D. Recent developments on social media regulation in Brazil
  5. E. Final remarks
4. Gerd Doeben-Henisch Download chapter (PDF)
  1. A. A Simple Timeline
  2. B. Cluster Effects
  3. C. Irritations
  4. D. Irritations in the Context of Digitalization
  5. E. Paradox: The Disappearance of Genius
  6. 1. I. Measuring Intelligence
    2. II. Cognition and Intelligence
    3. III. Intelligence in Psychology and AI
    4. IV. Human and AI
    5. V. Collective Human Intelligence and AI
    6. VI. Human in System Engineering
    7. VII. Can AI Help?
  7. 1. I. Language: With and without meaning
    2. II. Reality Check: True or false
    3. III. Cooperation: Models of the other
  8. H. Postscript
5. Being and Becoming in the Algorithmic AgePages 419 - 428 Bernard E. Harcourt Download chapter (PDF)
List of ContributorsPages 429 - 432 Download chapter (PDF)