Medical Decision Support
Medical Decision Support is a project funded by Precision Health FSP and Data61. It covers a range of activities
- Clinical trials search: Recruitment for clinical trials is non-trivial. Clinical trials which for example examine the efficacy of a treatment for a particular disease, require patients that match specific inclusion and exclusion criteria. We develop a system to assist clinicians and patients in finding clinical trials that match. Our system deploys a combination of Natural Language Processing (NLP), Machine Learning (ML), and Information Retrieval (IR) techniques to find the most suitable ranking and scoring methods for this complex problem.
- Biomedical literature search: Clinical decision support using the latest evidence published in the biomedical literature. We developed A2A benchmarking system to allow NLP/IR researchers working on biomedical search to compare the most common query formulation and text processing techniques on several biomedical datasets released by NIST/TREC over the years.
-
Patient-focused question answering: Patients, similar to physicians, require answers to their biomedical questions. We develop techniques to allow patients to find answers using a combination of NLP, IR, and deep learning techniques.
- Information extraction for proteomics: This is a collaboration with Flemish Institute of Bietechnology (VIB) and the Polish Academy of Sciences (PAN). Our goal is the identification of Post Translational Modification (PTM) information from scientific text. We use information extraction techniques to identify protein, gene, residue and position mentions in scientific texts.
International challenges (shared tasks)
We participated in the following challenges over the years:
- TREC Clinical decision support (2016)
- TREC Precision Medicine (2017-2020)
- N2C2/OHNLP Track on Family History Extraction (2019)
- N2C2/UMass Track on Clinical Concept Normalization (2019)
- TREC COVID (2020)
- TREC Clinical Trials (2021-2023)
Publications:
- Rethinking the Role of Entity Type in Relation Classification, AACL 2023
- A Self-Learning Resource-Efficient Re-Ranking Method for Clinical Trials Search. Maciej Rybinski, Vincent Nguyen, and Sarvnaz Karimi, CIKM 2023 (Runner-up Best Paper Award)
- MedRedQA for Medical Consumer Question Answering: Dataset, Tasks, and Neural Baselines.
Vincent Nguyen, Sarvnaz Karimi, Maciej Rybinski, Zhenchang XingThe 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL), 2023
-
Maciej Rybinski, Liam Watts, Sarvnaz Karimi
The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2022
-
V Nguyen, M Rybinski, S Karimi, Z Xing,Journal of Biomedical Informatics, 2022.
-
M Rybinski, S KarimiThe 30th International ACM International ACM Conference on Information and Knowledge Management (CIKM), 2021
- SearchEHR: A Family History Search System for Clinical Decision Support
X. Dai, M Rybinski, S KarimiThe 30th International ACM International ACM Conference on Information and Knowledge Management (CIKM), 2021
- Science2Cure: A Clinical Trial Search Prototype
M Rybinski, S Karimi, A KhooThe 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2021 (S2C short introduction)
- Family History Extraction from Electronic Health Records
M Rybinski, X Dai, S Singh, S Karimi, A NguyenJMIR Medical Informatics, Vol 9, no. 4, 2021 (Won Maciej and Dai the Best Early Career publication award in Analytics and Decision Sciences Programme, Data61, CSIRO)
- A2A: A Platform for Research in Biomedical Literature Search
M Rybinski, S Karimi, V Nguyen, C ParisBMC Bioinformatics, Volume 21 Supplement 19, 2020
- Pandemic Literature Search: Finding Information on COVID-19
V Nguyen, M Rybinski, S Karimi, Z Xing
Proceedings of the The 18th Annual Workshop of the Australasian Language Technology Association (ALTA), 2020 (Best short paper award)
- Clinical Trial Search: Using Biomedical Language Understanding Models for Re-Ranking
M Rybinski, J Xu, S KarimiJournal of Biomedical Informatics, 2020
- An experimentation platform for precision medicine
V Nguyen, S Karimi, B JinThe 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019
-
V Nguyen, S Karimi, Z XingProceedings of the The 17th Annual Workshop of the Australasian Language Technology Association (ALTA), 2019
- A2A: Benchmark Your Clinical Decision Support Search
S Karimi, V Nguyen, F Scholer, B Jin, S FalamakiThe 41st International ACM SIGIR Conference on Research and Development in Information Retrieval, 2018
Reports:
- CSIROmed Team Report of TREC 2021 Clinical Trials track, M Rybinski, V Nguyen, S Karimi, The 30th Text REtrieval Conference (TREC 2021) Proceedings
- CSIROmed at TREC Precision Medicine 2020, M Rybinski, S Karimi, The 29th Text REtrieval Conference (TREC 2020) Proceedings
- CSIRO at 2019 TREC Precision Medicine Track, M Rybinski, S Karimi, C Paris, The 28thText REtrieval Conference (TREC 2019) Proceedings
- CSIRO at 2017 TREC Precision Medicine Track, V Nguyen, S Karimi, S Falamaki, D Molla-Alloid, C Paris, S Wan, The 26th Text REtrieval Conference (TREC 2017) Proceedings
- CSIRO at TREC Clinical Decision Support Track, S Karimi, S Falamaki, V Nguyen, , The 25thText REtrieval Conference (TREC 2016) Proceedings
Presentations:
- CSIROmed at TREC Precision Medicine at TREC 2020 conference, November 2020 (Speaker: Maciej Rybinski)
- From Information Retrieval Benchmarking to Precision Medicine Knowledge Discovery, Joint NETTAB/BBCC 2019 Meeting (Speaker: Maciej Rybinski)
- AI in Health, CSIRO Connect 2019 (Speaker: Sarvnaz Karimi)
Prototypes and Resources:
- A2A (decision support): a2a.csiro.au
- A2A (literature search): a2a.csiro.au/benchmarking/
- S2C (Clinical trials): a2a.csiro.au/s2c
- A video explaining what Science2Cure (S2C) search prototype does!
- Medical research article summarisation and evaluation (domain experts to evaluate the quality of LLM-generated summaries, focusing on the faithfulness dimension)
- MedRedQA Dataset
Team:
- Dr Sarvnaz Karimi
- Dr Maceij Rybinski
- Dr Xiang Dai
- Dr Vincent Nguyen (PhD candidate in ANU, graduated 2023)
- Dr Hanna Pethani (PhD candidate in USyd)
We also collaborate and benefit from the advice and input of our colleagues at CSIRO and our university partners, including: Cecile Paris (CSIRO Data61), Stephen Wan (CSIRO Data61), Nathan O’Callaghan (PH FSP Leader, CSIRO Health & Biosecurity), Brian Jin (CSIRO Data61), Anthony Nguyen (CSIRO Health & Biosecurity), Sara Falamaki, Zhenchang Xing (ANU).
Past Students:
- Jerry Xu (Summer Intern, Sydney University, Nov 2019–Feb 2020)
- Aleney Khoo (Summer Intern, Sydney University, Dec 2020–Feb 2021)
- Jeffrey Yang (Summer Intern, UNSW, Dec 2020–Feb 2021)
- Sonit Singh (PhD student, CSIRO Data61 and Macquarie University, graduated 2021)
- Liam Watts (Summer intern, Nov 2021–Jun 2022)
- Mong Yuan Sim (Summer intern, Adelaide University, Nov 2022–Mar 2023)
- Anqi Wu (Summer intern, Monash University, Nov 2022–Feb 2023)
- Skyler Zou (Summer intern, UNSW, Nov 2022–Mar 2023)