The proposed research incorporates the development of innovative interactive interfaces where motion data sequences will be used for real-time music creation. Motion data refers to hand and body movements captured with appropriate sensing devices, in addition to musical audio data that will constitute the basic multimodal data collection on which deep learning neural networks architectures will be trained and evaluated.