Exploring Task Structure for Brain Tumor Segmentation from Multi-modality MR Images

Dingwen Zhang, Guohai Huang, Qiang Zhang, Jungong Han, Junwei Han, Yizhou Wang

Research output: Contribution to journalArticlepeer-review

86 Citations (SciVal)
386 Downloads (Pure)


Brain tumor segmentation, which aims at segmenting the whole tumor area, enhancing tumor core area, and tumor core area from each input multi-modality bioimaging data, has received considerable attention from both academia and industry. However, the existing approaches usually treat this problem as a common semantic segmentation task without taking into account the underlying rules in clinical practice. In reality, physicians tend to discover different tumor areas by weighing different modality volume data. Also, they initially segment the most distinct tumor area, and then gradually search around to find the other two. We refer to the first property as the task-modality structure while the second property as the task-task structure, based on which we propose a novel task-structured brain tumor segmentation network (TSBTS net). Specifically, to explore the task-modality structure, we design a modality-aware feature embedding mechanism to infer the important weights of the modality data during network learning. To explore the tasktask structure, we formulate the prediction of the different tumor areas as conditional dependency sub-tasks and encode such dependency in the network stream. Experiments on BraTS benchmarks show that the proposed method achieves superior performance in segmenting the desired brain tumor areas while requiring relatively lower computational costs, compared to other state-of-the-art methods and baseline models.
Original languageEnglish
Article number9199562
Pages (from-to)9032-9043
Number of pages12
JournalIEEE Transactions on Image Processing
Publication statusPublished - 17 Sept 2020


  • Machine vision
  • image analysis
  • object segmentation
  • supervised learning


Dive into the research topics of 'Exploring Task Structure for Brain Tumor Segmentation from Multi-modality MR Images'. Together they form a unique fingerprint.

Cite this