论文

arXiv 论文提出基于马尔可夫链的黑盒策略评估框架

Evaluating Feedback-Driven Black-Box Processes via Stochastic Modeling and Simulation

精选理由

搞 fuzzing 或顺序决策方向的朋友可以看看,作者用马尔可夫链把 9 个 fuzzers 在 18 个基准上做了统一对比,还给了带证明的评估流程。以前只能靠跑分经验比较,现在有理论支撑的度量方法,做实验设计时能少踩坑。

一篇 arXiv 论文针对反馈驱动的黑盒过程提出统一评估框架,核心方法是用马尔可夫链建模并配合仿真。论文以 mutation-based fuzzing 为实例:马尔可夫链的转移由变异策略决定,反馈来自程序执行结果,并配套了新的性能度量、可靠估计器和带可证明保证的评估流程。

正文

在实证部分,作者在 18 个广泛使用的 fuzzing 基准上评估了 9 个 fuzzers,并在 4 个非 fuzzing 领域做了案例研究,验证框架的通用性。

这类框架填补了黑盒策略缺乏统一评估标准的空白:许多现实系统不具备可做结构化假设的条件,以往各策略只能各自做经验比较。对安全研究人员和从事模糊测试、强化学习等顺序决策工作的开发者来说,这套带理论保证的度量与估计器可以直接用于复现和对比实验。

原文 · arXiv cs.LG

Evaluating Feedback-Driven Black-Box Processes via Stochastic Modeling and Simulation

We study feedback-driven black-box processes across software engineering and machine learning. These processes are inherently sequential: policies generate inputs, observe outputs/feedback from systems, and use the feedback to guide the design of subsequent inputs. While many policies are developed under structural assumptions on the underlying systems, many real-world systems operate without such knowledge, necessitating black-box policies that lack a unified evaluation framework. We introduce a stochastic framework that models and evaluates such policies using Markov chains and simulation, thereby connecting empirical practice with theory. We instantiate the framework in mutation-based fuzzing (widely used for discovering software bugs via sequential input mutation), by a novel Markov chain model of fuzzing whose transitions are governed by the mutation strategy and whose feedback is given by program execution. We develop a rigorous evaluation paradigm with new performance measures, sound estimators, and evaluation procedures with provable guarantees. Guided by the theory, we evaluate 9 fuzzers on 18 widely used fuzzing benchmarks and conduct case studies in 4 non-fuzzing domains. These results show that the framework provides a principled basis for evaluation while connecting to practice, with implications beyond fuzzing.

产业坐标与信源核验

本条情报归属 AITOP「论文」核心追踪栏目。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:fuzzing、马尔可夫链、arXiv、软件测试,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「arXiv cs.LG」(@Mengfan Xu, Zirui Liu, Juan Zhai, Shiqing Ma, Barry Nelson),经 AITOP 多维评分管线结构化提炼。