体育集锦生成新方法:用语义动作图统一AI生成与人类理解
Semantic Action Graph: A Shared Representation for Agent Grounding and Human Interpretation of Sports Highlights
朋友间推荐:体育迷们,试试这个新方法,它能让AI帮你生成足球集锦,还能让你自己通过图形界面去搜索和检查,比单纯看视频更方便。
这篇论文提出了一种名为语义动作图的新方法,用于体育集锦的生成。它将一场比赛表示为包含运动员、动作、接收者、时刻和状态的节点,通过角色、时间和结果边连接。这种方法能让AI生成集锦,同时也能让人类观众通过可视化界面查询和检查结构。在SportSAGE系统中,12名足球迷测试后反馈生成的集锦质量高,并使用图形界面进行搜索和导航。
Semantic Action Graph: A Shared Representation for Agent Grounding and Human Interpretation of Sports Highlights
Generative agents are increasingly used to select and narrate video highlights, but they typically operate over unstructured or frame-level representations. Their output is consequently difficult for a viewer to verify and steer toward individual preferences. We present the semantic action graph, a lightweight domain schema that represents a sports match as performer, action, recipient, moment, and state nodes connected by role, temporal, and outcome edges. The schema demonstrates three key properties: 1) connected event sequences, 2) a shared, closed vocabulary, and 3) frame-addressable moments, making it suitable to serve two consumers at once: an agentic pipeline that composes narrated highlights, and a visual interface through which viewers query and inspect the same structure. We instantiate it in SportSAGE, a design probe pairing a four-module highlight pipeline with a graph interface, and report feedback from 12 soccer fans. Participants were satisfied with the quality of the generated highlights and narratives, and used the graph interface to search, navigate, and interpret the match highlights. These results provide early evidence that one small, human-readable schema can ground agent generation and support human interpretation at the same time.