面向时间序列的自监督潜在动作条件世界建模
Self-Supervised Latent Action-Conditioned World Modeling for Time Series
Chia-Han Kuo · Chengshuai Zhao · Huan Liu · Lo Pang-Yun Ting
中文摘要
时间序列数据在天气预报、网络流量分析和语音识别等任务中具有重要作用。近期,一些前沿研究越来越多地采用基于联合嵌入预测架构(Joint-Embedding Predictive Architecture, JEPA)的编码器,通过潜在空间预测来学习时间序列表示。然而,这些方法往往忽略了支配时间序列观测之间转移的潜在因素。本文假设,显式建模时间序列变化背后的信息能够促进时间序列建模。基于这一假设,提出 ACTS-WM,一种用于时间序列分析的自监督潜在动作条件世界模型框架。首先,引入潜在动作建模方法,在无需显式动作标注的情况下,将时间序列转移背后的潜在信息推断为潜在动作。然后,开发基于 JEPA 的编码器和动作条件世界模型,以学习到的潜在动作和任务信息为条件,预测目标时间序列表示。在来自不同领域的 22 个数据集上,针对 4 类代表性任务(涵盖单变量和多变量预测与分类)评估 ACTS-WM。综合实验表明,ACTS-WM 通过学习互补表示,能够提升下游性能,优于预训练的基于 JEPA 的编码器。
关键要点
- 01现有基于 JEPA 的时间序列编码器忽略观测转移背后的潜在因素
- 02提出 ACTS-WM,无需动作标注即可推断潜在动作并条件化预测表示
- 03在 22 个数据集、4 类任务上验证,涵盖单变量与多变量预测及分类
- 04学习互补表示使下游性能优于预训练 JEPA 编码器
解读
尚无解读。
原始英文摘要
arXiv:2610.37963v1 Announce Type: cross Abstract: Time-series data play an important role in various tasks, such as weather forecasting, web traffic analysis, and speech recognition. Recently, pioneering studies have increasingly adopted Joint-Embedding Predictive Architecture (JEPA) based encoders to learn time-series representations through latent-space prediction. However, they often overlook the underlying factors governing transitions between time-series observations. In this work, we hypothesize that explicitly modeling the information behind changes in time series can facilitate time-series modeling. Building on this hypothesis, we propose ACTS-WM, a self-supervised latent action-conditioned world model framework for time-series analysis. First, we introduce a latent action modeling approach that infers the underlying information behind time-series transitions as latent actions, without requiring explicit action annotations. We then develop a JEPA-based encoder and an action-conditioned world model to predict target time-series representations conditioned on the learned latent actions and task information. We evaluate ACTS-WM across 4 representative tasks on 22 datasets from diverse domains, covering univariate and multivariate forecasting and classification. Comprehensive experiments demonstrate that ACTS-WM can improve downstream performance over pretrained JEPA-based encoders by learning complementary representations.