Abstract: In this paper, we propose a novel application of Haar scattering transform to learn features over multiple modalities data. A series of tasks for multimodal learning are presented, and the way of multimodal feature learning is shown. Furthermore, we validate our methods on several datasets with an classification task, demonstrating that the approach is effective.

Key words: Multimodal learning, Haar scattering transform, Classification task