The AI Whistleblower Initiative: Supporting AGI Insiders When It Matters Most, w/ founder Karl Koch

Today Karl Koch, Co-Founder of the AI Whistleblower Initiative, joins The Cognitive Revolution to discuss the barriers preventing AI insiders from raising safety concerns, his organization's anonymous "Third Opinion" service connecting whistleblowers with independent experts, and their campaign demanding frontier AI companies publish their internal whistleblowing policies to address widespread retaliation and lack of transparency.

Check out our sponsors: Oracle Cloud Infrastructure, Shopify.

Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at ⁠⁠⁠ ⁠ https://⁠⁠notion.com/lp/nathan
- AI Whistleblower Initiative Origins: Founded by Karl Koch in Berlin, the initiative began with research in early 2024 after consulting with over 100 governance researchers and insiders. Link to the website: https://aiwi.org/
- "Third Opinion" Proposition: Launched in late 2024, this program systematically breaks down barriers for insiders to speak up about AI concerns while ensuring their issues are addressed.
- Publish Your Policies Campaign: The initiative calls for AI companies to publish their whistleblowing and speaking up policies, with 100% of surveyed insiders supporting this transparency measure. Link to the campaign: https://aiwi.org/publishyourpolicies/
- Anonymous Consultation Process: Whistleblowers can seek advice without sharing confidential information through an open-source anonymous tool accessed via Tor browser.
- Pro Bono Legal Counsel: Whistleblowers receive connections to experienced legal representation with client privilege protection at any stage of their journey.
- Policy Advocacy: Beyond direct support, the initiative works on advocating for better whistleblower protections in both US policy and EU AI regulations.
- AI Whistleblower Initiative Survey: https://bit.ly/AIWISurvey

Sponsors:
Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive

Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive


PRODUCED BY:
https://aipodcast.ing

CHAPTERS:
(00:00) About the Episode
(07:12) Introduction and Background
(12:04) Deliberate Research Approach
(16:24) Whistleblowing Channels Explained (Part 1)
(20:27) Sponsor: Oracle Cloud Infrastructure
(21:36) Whistleblowing Channels Explained (Part 2)
(29:43) Nathan's GPT-4 Experience (Part 1)
(38:40) Sponsor: Shopify
(40:36) Nathan's GPT-4 Experience (Part 2)
(45:34) Psychological Strain Discussion
(55:05) Scale and Insider Numbers
(01:00:21) Survey Results Insights
(01:18:28) Public Scandals Problem
(01:28:40) Combating Internal Secrecy
(01:35:39) Publish Policies Campaign
(01:44:15) Support Services Overview
(01:49:44) Outro

SOCIAL LINKS:
Website: https://www.cognitiverevolution.ai
Twitter (Podcast): https://x.com/cogrev_podcast
Twitter (Nathan): https://x.com/labenz
LinkedIn: https://linkedin.com/in/nathanlabenz/
Youtube: https://youtube.com/@CognitiveRevolutionPodcast
Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431
Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk