Our Paper, DiffPrompter got accepted for IROS 2024 (Oral Pitch).