论文精选73°

PRICE研究:LLaMA-3 8B比特币价格预测

PRICE: A Systematic Study of LLM Adaptation Choices for Bitcoin Price Forecasting

精选理由

PRICE研究展示了如何通过特定技术组合,让文本预训练模型在比特币价格预测上超越专业时间序列模型。

PRICE研究基于4位量化的LLaMA-3 8B模型,探索了微调、数值表示、提示、推理和解码五种适应选择对短期比特币价格预测的影响。

正文

该研究结合了LoRA、递归多步推理、整数舍入数值表示、CTF提示和零温度解码技术。在八种基于Transformer和时间序列基础模型的比较评估中,PRICE在验证和测试集上实现了最低的预测误差。

原文 · arXiv cs.AI

PRICE: A Systematic Study of LLM Adaptation Choices for Bitcoin Price Forecasting

Cryptocurrency markets exhibit extreme volatility and non-stationary dynamics that challenge conventional forecasting methods. Although Large Language Models (LLMs) have shown promise for time series forecasting, the combined effects of adaptation choices remain largely unexplored in financial settings. This study introduces PRICE, a structured approach for adapting LLMs to short-term Bitcoin price forecasting. Built on a 4-bit quantized LLaMA-3 8B model, PRICE investigates how fine-tuning, numerical representation, prompting, inference, and decoding jointly influence forecasting performance. PRICE integrates Parameter-efficient fine-tuning with Low-Rank Adaptation (LoRA), Recursive multi-step inference, Integer-rounded numerical representation, Context-Task-Format (CTF) prompting, and Exact zero-temperature decoding. Ablation studies show that each component contributes to forecasting accuracy and reliability. LoRA enables efficient training on limited hardware, recursive inference improves accuracy, integer-rounded values reduce errors, CTF prompting outperforms Chain-of-Thought, Implicit Chain-of-Thought (iCoT), and few-shot prompting, and zero-temperature decoding improves stability during recursive forecasting. Comparative evaluation against eight transformer-based and time-series foundation models shows that PRICE achieves the lowest forecasting errors on both validation and test sets while maintaining robust performance across evaluation periods. Despite being based on a model primarily pretrained on text rather than time-series data, PRICE achieves competitive or superior performance relative to specialized foundation models. These findings demonstrate that adaptation choices critically determine the accuracy and robustness of LLMs for numerical time-series forecasting.

产业坐标与信源核验

本条情报归属 AITOP「论文」核心追踪栏目。在跨区域产业观察坐标中,该动态直接关联「AI 开发者工具链、Coding Agent 与工程化实践」研究主线,反映出当前技术演进与商业落地的最新风向。涉及核心实体与技术议题包括:PRICE、LLaMA-3、比特币、时间序列预测,读者可通过下方标签进入对应专题页查阅历史脉络与关联对比。

信源核验说明:本文原始线索采编自「arXiv cs.AI」(@Maryam Fakhari, Mehran Safayani),经 AITOP 多维评分管线结构化提炼。