Diffusion Pusht

🚀 Model Card for Diffusion Policy / PushT

This is a Diffusion Policy model trained for the PushT environment, which offers solutions for robotics tasks.

🚀 Quick Start

See the LeRobot library (particularly the evaluation script) for instructions on how to load and evaluate this model.

✨ Features

• Based on the Diffusion Policy, which is detailed in Diffusion Policy: Visuomotor Policy Learning via Action Diffusion.
• Trained for the PushT environment from gym-pusht.

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

No code examples are provided in the original document.

📚 Documentation

Training Details

Trained with LeRobot@3c0a209. The model was trained using LeRobot's training script and with the pusht dataset, using this command:

python lerobot/scripts/train.py \
    --output_dir=outputs/train/diffusion_pusht \
    --policy.type=diffusion \
    --dataset.repo_id=lerobot/pusht \
    --seed=100000 \
    --env.type=pusht \
    --batch_size=64 \
    --steps=200000 \
    --eval_freq=25000 \
    --save_freq=25000 \
    --wandb.enable=true

The training curves may be found at https://wandb.ai/aliberts/lerobot/runs/s7elvf4r. The current model corresponds to the checkpoint at 175k steps.

Evaluation

The model was evaluated on the PushT environment from gym-pusht and compared to a similar model trained with the original Diffusion Policy code. There are two evaluation metrics on a per-episode basis:

• Maximum overlap with target (seen as eval/avg_max_reward in the charts above). This ranges in [0, 1].
• Success: whether or not the maximum overlap is at least 95%.

Here are the metrics for 500 episodes worth of evaluation. The "Theirs" column is for an equivalent model trained on the original Diffusion Policy repository and evaluated on LeRobot (the model weights may be found in the original_dp_repo branch of this respository).

The results of each of the individual rollouts may be found in eval_info.json. It was produced after training with this command:

python lerobot/scripts/eval.py \
    --policy.path=outputs/train/diffusion_pusht/checkpoints/175000/pretrained_model \
    --output_dir=outputs/eval/diffusion_pusht/175000 \
    --env.type=pusht \
    --eval.n_episodes=500 \
    --eval.batch_size=50 \
    --device=cuda \
    --use_amp=false

📄 License

This project is licensed under the Apache-2.0 license.