Harry Grieve I Decentralizing Compute for Machine Learning I Gensyn I Pragma London 2024

Wed, Oct 2, 2024, 12:00 AM

Harry Grieve, co-founder of Gensyn, discusses decentralizing machine learning compute at Pragma London 2024. Learn how Gensyn's protocol creates a global supercluster of ML compute resources, enabling permissionless access to GPU power at lower costs than centralized providers. Discover the technical challenges of verifying distributed ML work, ensuring reproducibility across hardware, and optimizing model sharding. Explore the future intersection of crypto and AI, including machine-to-machine economic interactions and the coming wave of decentralized artificial intelligence. Essential viewing for ML engineers, blockchain developers, and anyone interested in the decentralized future of AI infrastructure. 00:00 - Introduction to Gensyn and Decentralized ML Compute 00:50 - The Growing Intersection of Crypto and AI 01:20 - Gensyn's Mission: Internet-Scale ML Training 01:57 - Founding Story: The GPU Access Problem 02:29 - Rising Compute Costs and GPT-2's Impact 03:02 - Academic vs Industry ML Resource Disparity 03:30 - Vision for Internet-Scale Machine Learning 04:01 - ML as the Next Industrial Revolution 04:31 - Transition to Dynamic AI-Powered Internet 05:02 - Controlling the Future of Online Information 05:32 - Training Models Across Any Compatible Device 06:03 - Five Key Research Challenges in Decentralized ML 06:33 - Reproducibility Across Different Hardware 06:58 - Optimal Model Sharding and Distribution 07:26 - Blockchain and Data Availability Considerations 07:51 - Current Status: Internal Network Testing 08:27 - Implementation Progress and Security Focus 08:55 - Data Availability Layer Requirements 09:52 - Four Key DA Needs for ML Protocols 10:22 - Temporary vs Permanent Storage Solutions 11:15 - Decentralized Model Training Research 11:45 - Physical Limits of Centralized Compute 12:18 - Breaking the Data Center Scaling Barrier 12:46 - Three Core Focus Areas for Gensyn 13:16 - Permissionless Network Principles 13:49 - Machine-to-Machine Compute Demand 14:23 - Autonomous AI Economic Agents 14:56 - The Liberty Argument for Decentralized AI 15:26 - Owning Your Artificial Neurons 15:51 - Crypto's Role in AI's Future 16:24 - Three-Layer Model for Crypto+AI Integration 16:50 - ML Ops: Attribution and Guardrails 17:23 - AGI on Cryptographic Substrates 17:49 - Four-Year Prediction for Permissionless AGI 18:23 - AI-Physical World Interface Challenges 18:55 - Gensyn's Roadmap: Private to Public Testing 19:27 - Research Opportunities in Distributed ML 19:56 - Need for External Data Solutions 20:23 - Closing Thoughts on Decentralized AI Future _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 🇬🇧 *Pragma London* Pragma London took place at Christchurch Spitalfields in London on March 14, 2024, and was an in-person summit for builders and leaders in the web3 ecosystem. Watch the full Pragma London playlist here: https://youtube.com/playlist?list=PLXzKMXK2aHh7rvaHBM14peT1TwI3QX38p&si=MzGrEYwYjxSQFiFM ETHGlobal's Pragma series takes place in cities around the world, and is designed to be a different kind of event. Pragma is a one-stage conference with founders-only on stage, bringing together a small group of curated attendees and speakers to discuss the future of web3 and reflect on the past. Ever since we first introduced our new event series Pragma in Tokyo of the spring of 2023, we have been fostering a curated, global community of individuals who deeply care about web3. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ✅ *Follow Harry Grieve* X: https://x.com/_grieve ✅ *Follow Gensyn* X: https://x.com/gensynai ✅ *Follow ETHGlobal* X: https://x.com/ETHGlobal​ Warpcast: https://warpcast.com/ethglobal Website: https://ethglobal.com YouTube: https://www.youtube.com/c/ETHGlobal _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _Are you interested in Ethereum development and entrepreneurship?_ 👉 Sign up for the next ETHGlobal event: https://ethglobal.com/events 🎁 Get exclusive access and perks with ETHGlobal Plus! https://ethglobal.com/plus 📣 Want us to throw an event in your city? Tell us where! https://ethglobal.com/city _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _