AI & ML Papers
32.9K subscribers
7.1K photos
529 videos
24 files
7.76K links
Advancing research in Machine Learning – practical insights, tools, and techniques for researchers.

Admin: @HusseinSheikho || @Hussein_Sheikho
Download Telegram
AI & ML Papers
Photo
🔥 A decoder-only foundation model for time-series forecasting

💡 The paper introduces a novel approach to time-series forecasting using a decoder-only foundation model. The authors draw inspiration from recent advances in large language models for natural language processing and adapt this concept to time-series forecasting. The problem addressed is the ability to achieve accurate forecasting results without requiring task-specific training data, which is a common challenge in time-series forecasting.

The method employed involves pretraining a patched-decoder style attention model on a large time-series corpus. This model is designed to work well across different forecasting history lengths, prediction lengths, and temporal granularities, making it a versatile solution for various time-series forecasting tasks.

The results show that the proposed model achieves near-optimal zero-shot performance on a variety of public datasets, coming close to the accuracy of state-of-the-art supervised forecasting models for each individual dataset. This is a significant contribution, as it demonstrates the potential for a single model to perform well across diverse datasets without requiring task-specific fine-tuning. Overall, the paper presents a promising approach to time-series forecasting, leveraging the strengths of large language models to achieve accurate and flexible forecasting results.


📅 Published on Oct 14, 2023

🔗 Links:
• arXiv: https://arxiv.org/abs/2310.10688
• PDF: https://arxiv.org/pdf/2310.10688
• GitHub: https://github.com/google-research/timesfm 19.4k

🤖 Models citing this paper:
https://huggingface.co/google/timesfm-1.0-200m
https://huggingface.co/google/timesfm-2.0-500m-pytorch
https://huggingface.co/google/timesfm-2.5-200m-pytorch

🚀 Spaces citing this paper:
https://huggingface.co/spaces/bahadirtonguc/timesfm-forecaster
https://huggingface.co/spaces/autogluon/fev-bench
https://huggingface.co/spaces/JayLacoma/Trader_Technical_Indicators

━━━━━━━━━━━━━━━━━━━━━━━━
📢 By: https://xn--r1a.website/PaperNexus

#TimeSeriesForecasting #DecoderOnlyModels #FoundationModelsForForecasting #PatchedDecoderAttention #TimeSeriesAnalysis
3