产品

YC 访谈:Intelligence 用 Design Arena 评测 AI 创意能力,年化收入达 6000 万美元

精选理由

700 万用户在 Design Arena 上用前沿模型做创意任务,偏好数据反过来帮模型厂商定位短板,一年做到 6000 万美元年化收入。喜欢 SWE-bench 之外另一种“真人评测”思路的话值得看看这场访谈,小团队打法部分对创业者也有参考。

YC 公司 Intelligence(2025 春季批次)正在为 AI 中最难量化的部分构建基准测试。其首个产品 Design Arena 让用户用前沿模型生成网站、图像、视频等创意作品,再把真实交互数据反馈给模型厂商,帮助他们了解模型在哪些场景成功、哪些场景失败。目前 Design Arena 已覆盖 192 个国家、超过 700 万用户。

图片来源 · Y Combinator
正文

产品机制上,Design Arena 通过真实用户的大规模使用来衡量“人类品味”,而非传统的静态基准测试。用户用多个前沿模型完成同一创意任务,其选择偏好沉淀为评测数据,随用户规模增长持续累积。这类“对齐人类偏好”的评测方式,区别于 SWE-bench 等以客观任务得分为主的基准。

商业层面,Intelligence 在约一年内达到 6000 万美元年化收入,团队规模保持小型。访谈还讨论了随着模型数量增多、领域专业化,专门化评测市场的发展方向,以及小团队在 AI 前沿创业中快速迭代的价值。

原文 · Y Combinator

Intelligence (S25) is building benchmarks for the parts of AI that are hardest to measure. Their first product, @DesignArena , lets people use frontier models to build websites, images, videos, and other creative work, then turns those real-world interactions into data that helps model labs understand where their models succeed and fail. Design Arena has grown to more than 7 million users across 192 countries, and @Intelligence_ai reached a $60 million annualized run rate in about a year. In this fireside, Intelligence founder and CEO @grx_xce joins YC’s @agupta to explain why measuring what people actually want could become increasingly important as AI models multiply and specialize. They also talk about what she’s learned building a new category at the frontier of AI, where moving quickly and learning as you go can matter more than already having the answers. 00:00 — How Design Arena Works 03:21 — From AI Games to Creative Benchmarks 06:43 — Measuring Human Taste at Scale 09:56 — A Marketplace for Specialized AI 13:52 — The Small Team Behind a $60M Run Rate 17:04 — Hiring Fast Learners and Taking Action 20:56 — Handling Rejection and Living in the Future

产业坐标与信源核验

本条情报归属 AITOP「产品」核心栏目,重点聚焦北美前沿实验室与硅谷科技巨头。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」「中美大模型技术代差与商业化对照」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:Design Arena、Intelligence、AI评测、基准测试,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「Y Combinator」(@ycombinator),经 AITOP 多维评分管线结构化提炼。截至目前,全网已有 2 家独立信源对该事件进行交叉印证与跟进报道(含 Recraft 等),属于近期高关注度行业信号。