Today I’m walking you through a problem that has cost me tens of thousands of dollars over the past year and eaten almost all of my engineering energy: token fraud. I’m the solo founder of ChatPRD, a bootstrapped AI platform for product managers, and fraudsters have been farming our free trials, reselling promo codes, wrapping the product in relays, and installing a custom MCP that ran as a 24/7 compute worker. I’ll walk through the six abuse patterns I’ve seen, the business and technical controls I put in place, the Jev loop that classifies fraud in real time, and why I finally killed free tr
How I AI
@nick-test/how-i-ai
Scott Farrar is a math educator and parent who got tired of AI chats that drift and forget. So he built a household brain in Claude Code: a folder of Markdown files, viewed in Obsidian, that knows his appliances, warranties, insurance documents, and everything on his family’s to-do list. In this episode, Scott shows how he uses it to shop for car insurance, plan repairs, share the system with his wife, and put priority tasks and recent wins on a wall display. We also talk about AI and math learning, and why he wants AI to keep kids doing the thinking.
Anthropic just released Fable 5.2, their new frontier model, and I spent two days actually building things with it before recording this. I made an animated marketing video from a single tweet, assembled a pile of unboxed furniture using only blurry floor photos, and extended our CXO brand sprites into a full bug-defense game complete with a trailer. In this episode I walk through what impressed me, what fell down, and how I’m thinking about routing tasks between Fable 5.2 and Opus 5.5 going forward.
William Imoh is the founder of Hackmamba, a developer marketing company, and the creator of Mural, a real-time voice app he built to learn Norwegian after moving from Dubai to Norway. He has a chemical engineering degree, taught himself to code, and spent four years as a product manager, but he had never written a line of Swift. In this episode, William shows how he used Codex and GPT-Live to build Mural natively for iOS and Android, then walks through the Lord of the Rings–themed Grok Bot “fellowship” that helps him run a team of about 25 as a solo founder.
Ezra Mechaber is a growth product manager at Figma whose goal is to be “lazy in the right places.” When he joined Figma, he found almost no one outside engineering using AI to get real work done, so he and a couple of fellow PMs turned his personal Claude Code setup into PM OS, a shared repo of 31 skills that every PM at Figma now uses. In this episode, Ezra walks me through his favorite skills, how he bug bashes with Codex, AutoXP—an automated growth PM that found a huge win on its very first experiment—and a real-time writing assistant he built with Jev.
I have personal-agent fatigue, so I ran the first How I AI personal-agent benchmark: Grok Bot, Dot, Muse, and Claude Duet across nine real tasks, from a Slack reply and a Sentry bug to a Figma thumbnail, inbox triage, a family newspaper, physics homework for a fourth grader, shoe shopping, and a ChatPRD launch video. I used computer use to operate them: Claude ran Dot, Codex ran the rest and scored the results live. Here’s the scoreboard—and which agent I’d actually trust for work vs. life.
Blair Metcalf is the principal UX engineer at Reddit and the builder of Reddit Proto, the company’s in-house vibe-coding harness. With a design system MCP that maps Reddit’s product language to production code, Proto has reached 100% adoption across Reddit’s UX and product org, and more than 700 prototypes are live on it.
Anthropic's new personal agent, Claude Duet, lives on your phone, inherits all your Claude plugins and connectors, and is pitched at small business owners and busy professionals. It's the most polished agent launch I've seen: thoughtful onboarding, task lists, first-class artifacts, and Slack-style channels. But polish isn't enough when you're competing with every other personal agent for attention. I put it to work on my inbox and Slack, my sales pipeline, a Google Docs sales deck, a launch video, and finding Warriors tickets for my kids, and I'll walk you through what it nails, where it stal
Brooke Lacey has been making videos since before Facebook had video, and she built a TikTok audience of more than 290,000 by learning to cut short-form videos herself. With over 25 years in tech, she now builds her own apps, including Zosha, a free mobile app for learning AI. In this episode, Brooke walks me through the Claude Code, FFmpeg, and Whisper workflow that edits her TikToks in about 15 seconds, how she mines her comments for new scripts, and how she runs a weekly short-form operation with no editor.
I put Meta’s new Muse Wonder (and Wonderful) frontier models through the How I AI bench, which covers nearly 20 tasks across prototyping, agentic workflows, coding, writing, and creative work. I scored everything with an LLM-as-a-judge pass and my own voice notes, then pulled together the first-look results you see here.
Alex Cornell is a design director at Meta, where he leads design on Muse, Meta’s consumer AI agent. He came to the role with a long background in software product design, including time as a founder, and has spent the past year building one of the most thoughtful agent interfaces in the consumer AI space. Muse ships with a custom avatar, a three-layer status display, a personalized ideas surface, and a generative feed. Alex has been sharing the reasoning behind each of those design decisions publicly on Threads.
Kath Korevec is a member of the Product staff at OpenAI working on Codex, and she spent over a year building and using ChatGPT Sites internally before its public launch. She’s been on the front lines of shipping Plugin Insights, MCP plugin hosting, and the connector ecosystem, which now includes around 60 integrations.
John Lindquist created egghead.io, a developer education platform used by hundreds of thousands of working engineers. These days he’s building mega.dev, a hands-on program specifically for developers who want to do real work with AI agents, not just prototype them.
I spent the day at OpenAI’s DevDay in San Francisco, and I have good news and bad news: OpenAI released a lot of stuff.
Jev is TypeSafe AI’s new decision model. It returns type-safe structured values (a choice, a score, a probability) instead of generated text, at 4 cents per million input tokens with no output charge. This week I ran it on five real projects: PR categorization, a meta-analysis of my own Claude and Codex sessions, Gmail triage, the ChatPRD product insights graph, and a live audience dashboard built from 4,500 YouTube comments.
I got up early to record an Opus 5.5 review. Then Anthropic and OpenAI dropped new models on the same morning, and I decided to do something I’d never done before: take the How I AI bench live. I put GPT-6 Astra, GPT-6 Sol, Claude Opus 5.5, and more through the work I actually care about: emails, PRDs, frontend prototypes, backend work, long-running agents, SVGs, and video editing. I scored the outputs without knowing which model made them, so you get to watch me make predictions, change my mind, and reveal my own very inconsistent taste. Astra won my heart. Opus 5.5 won my week. Sol still has
I’ve been off Claude for months. Not because it got dumb, but because it got annoying. The rambling, the hedging, the preachy little disclaimers on tasks that didn’t need them. I moved most of my daily work to Codex and I didn’t miss it. Then Anthropic shipped Opus 5.5: 40% cheaper than Opus 5, faster, and with what they’re calling a fundamentally different alignment approach. I ran it for a week across real work, including four long-running agentic tasks, a full ChatPRD homepage redesign, an SVG benchmark, and one very firm refusal, and I’m ready to give you the honest verdict. There’s a lot
Zach Lloyd is the co-founder and CEO of Warp, an AI-powered terminal and software factory platform used by tens of thousands of engineers. Before Warp, he spent nearly a decade at Google, including time as a principal engineer on Google Sheets. He built Warp from the ground up as a modern, AI-native alternative to legacy terminals, and the team has since expanded into software factories: a full cloud-based system that takes an idea in Slack all the way through to a merged PR.
I spent a few hours putting Meta’s Muse, its new personal AI agent, through a real first-pass test: onboarding, calendar management, goal setting, a one-shot family morning newsletter, browser-based shopping, and the animated avatar that honestly surprised me.
John Bai and Peng Zheng are designers on the Grok Bot team at SpaceXAI, where they’re building one of the most talked-about AI products right now. John writes publicly about his design process (his piece “Designing Grok Bot with Grok Bot” has already made the rounds) and shares bot templates with the design community. Peng brings a product-design sensibility to personal tools, and his website doubles as a live demo of what he builds.
Sharadh Krishnamurthy is an engineering manager at Stripe, where he helped build Kai, the company’s internal AI agent used by more than 10,000 employees every week. He’s worked across several of Stripe’s core infrastructure teams, including data and developer experience, which gives him a grounded, systems-level perspective on what it actually takes to make AI work at enterprise scale. He’s currently focused on the governance, skills, and infrastructure layers that let every Stripe employee use AI safely and effectively, regardless of their technical background.
I got early access to GPT-6 Astra: when I say this model broke through tasks I couldn’t crack with 5.6 Sol or Fable, I mean it specifically: the ChatPRD product intelligence feature, building 3D games, the hardware hack, and a handful of one-shot coding projects I’d tried and failed on repeatedly.
I’m running about 30 active agents at any given moment, and in this episode I break down my full Grok Bot setup: what it is, how it compares to OpenClaw, and the nine bots I’ve built for work and my personal life. We go deep on Chief (my chief-of-staff bot sweeping six inboxes and multiple Slack workspaces), TradBot (the family agent that prints a kitchen-table newspaper for my kids), two engineering bots handling my PR queue and SOC 2 compliance monitoring, Holly Helpdesk, and a handful of personal bots I didn’t expect to actually love. I also walk through how I migrated everything from OpenC
Daniel Blum is a product manager at Melio, a B2B payments company, and one of the most systematic thinkers I’ve had on the show when it comes to personal AI infrastructure. He’s spent the past year building a Claude- and Cowork-based productivity system that manages his Notion board, processes his Slack and email, and runs self-improvement loops every week without needing to be prompted. Beyond his own workflow, Daniel built and scaled a “Workstation” onboarding plugin that gets any Melio employee up and running with a personalized Claude setup in about 15 minutes.