Multimodal Synthetic Data for Deep Neural Networks (MSynD) workshop

Members of the Imaging and Computer Vision group are organising Multimodal Synthetic Data for Deep Neural Networks (MSynD) workshop at the International Joint Conference on Neural Network (IJCNN). IJCNN is a premier international conference in the area of neural networks theory, analysis and applications, and this year 2023, the conference will be held in Gold Coast, Queensland, Australia. There is a significant overlap between our group’s research focus and IJCNNs theme in developing deep neural network models and applications. At this event would want to discuss the current trend in using multimodal synthetic data for deep neural networks with world-leading experts attending IJCNN and our workshop.

Who this workshop is for?

Multimodal Synthetic Data for Deep Neural Networks workshop focused on the generation and use of synthetic data to train, evaluate, and deploy deep neural networks. We aim to bring together researchers, practitioners, and industry experts in the field of artificial intelligence (AI) and machine learning to discuss the latest advancements, opportunities and challenges in using synthetic data for training deep neural networks in various applications, such as computer vision, natural language processing, speech recognition, robotics, healthcare, and more.

Our goal is to provide a platform for researchers and practitioners to exchange ideas, share their research findings, and discuss best practices and ethical considerations in using multimodal synthetic data. The workshop is designed for individuals who are interested in exploring and advancing the use of synthetic data for training deep neural networks across multiple modalities, including audio, video, text, and sensor data. Specifically, this workshop is intended for:

• Researchers and Academics: Researchers and academics in the fields of artificial intelligence, machine learning, computer vision, natural language processing, speech recognition, robotics, healthcare, and related disciplines who are interested in exploring and advancing the use of synthetic data for deep neural networks.
• Industry Professionals: Industry professionals, practitioners, and data scientists working in AI-related industries who are interested in incorporating synthetic data into their deep neural network training pipelines.
• Data Scientists and Engineers: Data scientists, engineers, and practitioners who are involved in data generation, data augmentation, and data pre-processing for deep neural network training, and are interested in learning about state-of-the-art techniques and best practices in using synthetic data.
• Graduate Students and Early Career Researchers: Graduate students, early career researchers, and individuals pursuing research or careers in AI-related fields, who are interested in gaining insights into the latest advancements and challenges in using synthetic data for deep neural networks.
• Ethicists and Legal Experts: Ethicists, legal experts, and professionals involved in the ethical implications and legal aspects of artificial intelligence, machine learning, and data generation, who are interested in understanding the ethical considerations and responsible use of synthetic data in deep neural network training.

When and Where?

When: Friday, 23 June 2023

Where: Gold Coast Convention and Exhibition Center, Gold Coast, QLD, Australia

Host conference: International Joint Conference on Neural Network (IJCNN)

Call for Abstracts

We are delighted to invite one-page extended abstracts at MSynD workshop. Topics of interest for this workshop include, but are not limited to:

• Synthetic data generation techniques (audio, video, text, sensor data) for various applications
• Combining modalities in synthetic data generation
• Novel approaches for using synthetic data
• Evaluation and benchmarking of deep learning models trained on synthetic data
• Best practices, guidelines, and ethics in using synthetic data
• Case studies and real-world applications of synthetic data
• Strategies for domain adaptation and transfer learning with synthetic data
• Data augmentation techniques using multimodal synthetic data for improving the robustness and generalization of deep learning models.
• Limitations, challenges, and future directions of using multimodal synthetic data for deep neural networks.

Submission Guideline

1. Submission website via CMT: https://cmt3.research.microsoft.com/MSYND2023. If you new to CMT please have a look at their how-to guide for authors
2. Submission template: Author guidelines for MSYND 2023 1-page abstract
3. The authors should strictly follow the one-page extended abstract template. Any manuscripts exceeding the one-page limit may be rejected.
4. MSynD workshop will use the single-blind reviewing process for one-page abstracts.
5. Abstracts will be reviewed for suitability by related experts from the organising and review Committee.
6. Accepted abstracts will be invited for presentation at the workshop.

Important Dates

Abstract submission deadline: 22 May 2023
Acceptance Notification: 29 May 2023
Registration: Now closed [Register from IJCNN website]
Workshop date: 23 June 2023 8:00 AM to 12:30 PM

Workshop program

Virtual link: Via ZOOM [Managed by IJCNN]

What (Keynote/Paper)	When	Who
Welcome and Registration	8:00 AM to 8:30 AM	Moshiur Farazi
Keynote 1: Synthetic data in biomedical image processing By Olivier Salvado (Chief Research Scientist, Data61 – CSIRO)	8:30 AM to 9:00 AM	Olivier Salvado
Presentation 1: On the Importance of Section Embeddings for Chest X-Ray Report Generation By Aaron M Nicolson (CSIRO); Jason A Dowling (CSIRO); Bevan Koopman (CSIRO)	9:00 AM to 9:15 AM	Aaron M Nicolson
Presentation 2: Medical image synthesis with misaligned multimodal paired data Authors: Bowen Xin (CSIRO)*; Jason A Dowling (CSIRO)	9:15 AM to 9:30 AM	Bowen Xin
Presentation 3: Differential image Privacy Preservation using Novel Generative Model By Huaxi Huang (CSIRO)*; Xin Yuan (CSIRO); thierry rakotoarivelo (Data61-CSIRO); Olivier Salvado (CSIRO); Dadong Wang (CSIRO); Tongliang Liu (The University of Sydney)	9:30 AM to 9:45 AM	Huaxi Huang
Presentation 4: Generating continuous hand gestures on rendered digital avatar by Junlin Luo (The University of Queensland)*; Xin Shen (Austrian National University); Hu Zhang (University of Queensland); Xin Yu (University of Queensland); Dadong Wang (CSIRO)	9:45 AM to 10:00 AM	Junlin Luo
Tea break	10:00 AM to 10:30 AM	Everyone
Keynote 2: Finding the unexpected in astronomy data sets by George Hobbs, Group Leader – Space and Astronomy CSIRO	10:30 AM to 11:00 AM	George Hobbs
Keynote 3: Learning from Limited Samples: Synthetic Data come to the Rescue by Xin Yu, Senior Lecturer – University of Queensland	11:00 AM to 11:30 AM	Xin Yu
Presentation 5: Forecasting Offshore Turbidity Currents Using Deep Learning Models Farid Fazel Mojtahedi (The University of Melbourne)*; Negin Yousefpour (The University of Melbourne ); Shiaohuey Chow (The University of Melbourne ); Mark Cassidy (The University of Melbourne )	11:30 AM to 11:45 AM	Farid Fazel Mojtahedi
Presentation 6: Adversarial generation of solutions in expensive optimization Authors: Roberto Santana (University of the Basque Country (UPV/EHU))*	11:45 AM to 12:00 PM	Roberto Santana
Presentation 7: High spectral spatial resolution synthetic hyperspectral dataset form multi-source fusion Authors: Yajie Sun (Griffith University)*; Ali Zia (Australian National University); Jun Zhou (Griffith University)	12:00 PM to 12:15 PM	Yajie Sun
Presentation 8: Open-world Audio Visual Segmentation via Enriching the audio-visual feature space Authors: Chen Liu (The University of Queensland)*; Peike Li (UTS); Hu Zhang (University of Queensland); Xin Yu (University of Queensland); Dadong Wang (CSIRO)	12:15 PM to 12:30 PM	Chen Liu
Closing and Thanks	12:30 PM-12:45 PM	All organisers

Organisers

Contact: msynd2023organisers@gmail.com