基于自注意力机制与UNet模型的心脏图像分割

s the development of medical image processing,automatic Cardiac MRI segmentation has been one of the most important issues. However,the unclear boundaries and inhomogeneous intensity in MRI images usually cause indistinction for pixels from different class around boundaries,limiting accuracy of the segmentation result. In this paper,Transformer which is common in natural language processing is introduced into UNet,which is common in medical image segmentation to capture global information;meanwhile,direction feature is used enhance comparison for inter-classes pixels for better performance near the boundaries. The network can be divided into segmentation module and direction feature module:self-attention mechanism is used to replace the convolution module in building blocks for long-range dependence;result of segmentation module is taken as input of direction feature module,which utilize direction vector from pixel to its nearest boundary pixel to improve segmentation accuracy near by boundaries. Performance of the network is evaluated on the 2017 MICCAI Automated Cardiac Diagnosis Challenge (ACDC) dataset and Multi-Centre, Multi-Vendor & Multi-Disease Cardiac Image Segmentation Challenge dataset and got satisfied result.