# Pre-trained Foundation Model

PatchTST is a pre-trained time series foundation model, focusing on time series forecasting tasks.

Zamba-7B-v1-phase1 is a hybrid architecture combining state space model Mamba with Transformer, using Mamba as the backbone network and sharing one Transformer layer every six modules, trained via next-token prediction.