Fredrik Haga I Analytics at Scale V02 I Dune I Pragma London 2024

Wed, Oct 2, 2024, 12:00 AM

Fredrik Haga, co-founder of Dune Analytics, discusses the evolution of blockchain data analytics at Pragma London 2024. Learn how Dune transformed from a small Telegram community to the leading on-chain analytics platform, the challenges of scaling data infrastructure across multiple chains, and their vision for an open data ecosystem. Discover how Dune is leveraging AI to simplify data queries and their approach to handling the exponential growth of L2s and app chains. Essential viewing for data analysts, blockchain developers, and anyone interested in the future of transparent, on-chain analytics. 00:00 - Introduction to Dune Analytics and Fredrik Haga 00:51 - The Early Days of Blockchain Data Challenges 01:26 - Founding Dune During Crypto Winter 2018 02:02 - Recognizing the Need for On-Chain Analytics 02:35 - The Epiphany: Public Blockchain Data as Opportunity 03:04 - Unique Aspects of Open Blockchain Data 03:36 - Building for Open Data vs Traditional Silos 04:07 - Has Querying On-Chain Data Gotten Easier? 04:36 - The Current State of Blockchain Data Tooling 05:05 - Progress and Remaining Challenges in Data Analytics 05:39 - The Dune Wizards Community Origin Story 06:09 - Serving the Early Crypto Data Enthusiasts 06:37 - Community Growth During DeFi Summer 2020 07:05 - Open Collaboration vs Data Silos 07:35 - The Inflection Point of DeFi Summer 08:08 - Engineering Challenges of Scaling Dune 08:40 - Handling Arbitrary User Queries at Scale 09:15 - Challenges with Ethereum Forks and High-Throughput Chains 09:42 - Supporting Solana and Other High-Volume Chains 10:20 - Scaling the Dune Team to 45 People 10:51 - Managing Through Crypto Market Cycles 11:27 - The Coming Wave of Thousands of L2s and App Chains 11:58 - Dune's Platform Approach to Chain Fragmentation 12:29 - Transitioning to an Open-Ended Data Platform 12:57 - Enabling Community Data Contributions 13:25 - Expanding Beyond Strictly On-Chain Data 13:57 - APIs and Data Sharing Features 14:27 - AI and Natural Language Query Innovations 14:56 - The Role of Human Curation in Analytics 15:29 - Combining Community Insights with AI 16:04 - Underutilized Potential of On-Chain Data 16:34 - Comparing Web2 vs Web3 Data Accessibility 17:03 - Accelerating Startup Feedback Loops 17:33 - The Power of Open Data for Builders 18:02 - Closing Thoughts on Open Data Ecosystems _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 🇬🇧 *Pragma London* Pragma London took place at Christchurch Spitalfields in London on March 14, 2024, and was an in-person summit for builders and leaders in the web3 ecosystem. Watch the full Pragma London playlist here: https://youtube.com/playlist?list=PLXzKMXK2aHh7rvaHBM14peT1TwI3QX38p&si=MzGrEYwYjxSQFiFM ETHGlobal's Pragma series takes place in cities around the world, and is designed to be a different kind of event. Pragma is a one-stage conference with founders-only on stage, bringing together a small group of curated attendees and speakers to discuss the future of web3 and reflect on the past. Ever since we first introduced our new event series Pragma in Tokyo of the spring of 2023, we have been fostering a curated, global community of individuals who deeply care about web3. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ✅ *Follow Dune* X: https://x.com/Dune ✅ *Follow ETHGlobal* X: https://x.com/ETHGlobal​ Warpcast: https://warpcast.com/ethglobal Website: https://ethglobal.com YouTube: https://www.youtube.com/c/ETHGlobal _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _Are you interested in Ethereum development and entrepreneurship?_ 👉 Sign up for the next ETHGlobal event: https://ethglobal.com/events 🎁 Get exclusive access and perks with ETHGlobal Plus! https://ethglobal.com/plus 📣 Want us to throw an event in your city? Tell us where! https://ethglobal.com/city _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _