Home Podcasts Training Data
Training Data

Training Data

Sequoia Capital 95 Episodes Oct 13, 2026

Join us as we train our neural nets on the theme of the century: AI. Sonya Huang, Pat Grady and more Sequoia Capital partners host conversations with leading AI builders and researchers to ask critical questions and develop a deeper understanding of the evolving technologies—and their implications for technology, business and society.

Episodes

David Silver and Lasse Espeholt of Ineffable Intelligence: A Superlearner for the Age of Experience
David Silver and Lasse Espeholt of Ineffable Intelligence: A Superlearner for the Age of Experience Oct 13, 2026 4082 David Silver spent two years building AlphaGo on human data. When he removed human data altogether building AlphaGo Zero, the AI surpassed AlphaGo in under two days. He left DeepMind to run that same bet in pursuit of superintelligence. David and Lasse Espeholt, co-founders of Ineffable Intelligence, explain their plan to build a “superlearner”—an agent that starts knowing nothing and discovers sc
Google's AI Infrastructure Chief, Amin Vahdat, on the Physics & Economics of Frontier AI
Google's AI Infrastructure Chief, Amin Vahdat, on the Physics & Economics of Frontier AI Oct 6, 2026 3866 At 100,000-accelerator scale, something fails multiple times an hour, which is why Google's Chief Technologist for AI Infrastructure Amin Vahdat thinks FLOPS is a vanity metric. The metric that matters is what he calls goodput: the useful work a workload actually delivers through real failures. Amin walks through the calculus that split the TPU line into 8i and 8t for the first time, why the TPU's
Box's Aaron Levie: On Reinventing Yourself in the AI Age and Enterprise Diffusion
Box's Aaron Levie: On Reinventing Yourself in the AI Age and Enterprise Diffusion Sep 15, 2026 3921 Starting a company is hard. Reinventing your company for AI as a public company with quarterly earnings results is even harder. Aaron Levie has pulled off the transition with Box and offers hard-won advice for founders. The cofounder and CEO of Box argues the value isn't only in the model; it's in the bridge from a model's raw capability to the actual workflow inside a bank, a law firm, or a pharm
Making Cities Awesome: Peregrine’s Nick Noone & Ben Rudolph
Making Cities Awesome: Peregrine’s Nick Noone & Ben Rudolph Sep 1, 2026 3147 Most public safety technology companies grow by collecting more data. Peregrine inverted the model: no sensors, no new data, a business built on connecting the data and information cities already own. Co-founders Nick Noone and Ben Rudolph received more than two dozen no's before San Pablo PD let them in the door in February 2018. Today, Peregrine powers law enforcement, emergency medical services
Parallel’s Parag Agrawal: Building a New Web for AI Agents
Parallel’s Parag Agrawal: Building a New Web for AI Agents Aug 25, 2026 3318 Parag Agrawal is making a bet that goes against two decades of web search: agents will query the web a thousand times more than humans ever have, and the infrastructure built around human clicks is wrong for them. The former Twitter CEO, now founder and CEO of Parallel Web Systems, explains why Parallel treats human click data as a bug and trains on agent feedback instead. He unpacks the counterin
Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again
Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again Aug 18, 2026 3223 Rich Sutton, who helped pioneer reinforcement learning and wrote the seminal AI essay The Bitter Lesson, has now cofounded Oak Lab with his former student Khurram Javed. Their goal: to build agents that continuously learn from their own experience rather than from us. Rich doesn't think he holds a radical view: "I'm not weird. The field is weird." He says all learning is continual, and the field i
Chai Discovery's Bitter Lesson: Drug Design Is Another Scaling Problem
Chai Discovery's Bitter Lesson: Drug Design Is Another Scaling Problem Aug 4, 2026 2842 Most people treat biology as a bespoke, messy science. Josh Meier and Matt McPartlon, co-founders of Chai Discovery, treat it as an engineering problem. They make the case that drug design obeys the bitter lesson: scale data, models, and compute, and the model can learn what a hand-built pipeline simply couldn't capture. The results are concrete: Chai-2 pushed de novo antibody design from a sub 0.
Building the Automated AGI Lab: Core Automation's Jerry Tworek and Rohan Anil
Building the Automated AGI Lab: Core Automation's Jerry Tworek and Rohan Anil Jul 29, 2026 2951 Jerry Tworek led reasoning at OpenAI, convinced that scaling reinforcement learning was the path to AGI. Rohan Anil co-led Gemini pre-training and built the Shampoo optimizer. Now they've teamed up at Core Automation on a contrarian premise: the transformer has carried us as far as it can, and the bottleneck to smarter systems is no longer scale — it's the architecture itself. The missing capabili
Factory's Matan Grinberg: The Coming ‘Dark Factory’ Where Software Builds Itself
Factory's Matan Grinberg: The Coming ‘Dark Factory’ Where Software Builds Itself Jul 21, 2026 3091 Factory started building fully autonomous coding agents in April 2023, two years before enterprises were ready. Matan Grinberg now says this is indistinguishable from being wrong. The Factory co-founder and CEO explains how the company survived its "journey in the desert," including the decision to hand nearly all of its revenue back to customers when the product wasn't making developers obsessed.
Anthropic's Katelyn Lesse & Angela Jiang: Building an Ecosystem, not a Walled Garden
Anthropic's Katelyn Lesse & Angela Jiang: Building an Ecosystem, not a Walled Garden Jul 14, 2026 2934 Katelyn Lesse and Angela Jiang lead the team building Anthropic's developer platform - the layer that both outside builders and Anthropic's own products run on top of. Angela frames the platform as a three-layer stack: knowledge, execution, and coordination. She argues the real leverage is what’s at the top: "strategies," or meta-harnesses that give each token a different job, from advising to exe
Inside Zipline's Autonomous System: 140M Miles, Zero Incidents
Inside Zipline's Autonomous System: 140M Miles, Zero Incidents Jul 7, 2026 3318 The largest commercial autonomous system on earth isn't a robotaxi fleet — it's Zipline, which has flown 140 million autonomous miles with zero safety incidents. Co-founder Keller Rinaudo Cliffton and Eric Watson, who leads systems engineering and safety, explain why the drone itself is only 15% of the solution. The rest spans inventory management, air traffic integration, and engineering systems
Why Hardware-Software Co-Design Is AI's Real 100x: Dylan Patel of SemiAnalysis
Why Hardware-Software Co-Design Is AI's Real 100x: Dylan Patel of SemiAnalysis Jun 30, 2026 4214 Dylan Patel, founder of SemiAnalysis, argues the biggest gains in AI don't come from faster chips, they come from software-hardware co-design. Optimizing the model, the kernels, and the silicon together turns a 2x here and a 2x there into 100x. He explains why DeepSeek's experts were shaped for Nvidia's Hopper (and why TPUs struggle to run it), why OpenAI's sparser models and Anthropic's denser on

Recommended