Blog: vibe code and token maxx like a ceo

Vibe-coding has, of late, transformed from a novelty among programmers into a mainstay of the software industry. Garry Tan, Y Combinator’s president, has returned to hands-on coding for the first time since his early days of founding a software company, and has praised AI’s ability to quickly reproduce his early software product. Mark Zuckerberg has similarly returned to coding, making his first substantive pull requests to Meta’s production code for the first time in 20 years.

Some may dismiss vibe-coding as an advancement in slop-making or a phenomenon in C-suite micro-management, but I find myself in partial agreement with Jensen Huang’s comment that he would go “ape something else” if an engineer on a $500,000 salary were to spend only $5,000 in tokens—there have to be some ways in which AI can save your precious time. On a similar note, a resident AI expert at I2SC has similarly cautioned us against sparing tokens: if 10 hours of your work can be eliminated by $100 in tokens, use the tokens, because you know how much your time is worth. In other words, keep token-maxxing as long as the marginal cost of tokens doesn’t outweigh the marginal labor cost.

What else might be stopping us from token-maxxing? An externality that can be easily overlooked is the environmental cost, much of which comes from the electricity consumption. Since the frontier AI labs do not publish data about their electricity use or cost of tokens to them, I find a third-party report equating the consumption from 1 ChatGPT query to that from a few minutes of lightbulb use, as well as a programmer’s estimate that his Claude Code uses just as much electricity as his refrigerator. If these estimates are accurate, I have consumed 30 kWh of electricity, or 1/5 the consumption of a typical one-person household in Germany, over the past month from the 100 million tokens I burnt through. To my relief, this is not nearly as high as I had anticipated, although still not small enough to be trivialized.

What have those 100 million tokens delivered for you, you may wonder. I cannot disclose it here, but I hope to be able to share some exciting news in my next blog post.

(Written by Jianlong as a recap of his presentation during the group meeting on 15 July.)

Popular posts from this blog

AI Girlfriend or AI Boyfriend? Social Determinants of Human-AI Relationships

Showcase from the AI in the Global South seminar: Project #2 - Malam: A Low-Bandwidth AI Math Tutor for Afghan Girls

Job: Student Research Assistant (m/w/d) for AI & Misinformation detection