Using nnU-Net with 2D RGB images and custom data splits

nnU-Net is now considered a standard and state-of-the-art tool for medical image segmentation, but, I think that it is opinionated in the following ways that affect how I may use it: It enforces a specific training and evaluation workflow, including assumptions about data splits. This means using custom train-valid-test splits requires some workarounds. It assumes 3D volumetric data, and while 2D data is supported, it’s the not the primary use case. It assumes grayscale images, and does not support RGB images out of the box. This again means that RGB images require some workarounds. A lot of researchers, however, happily use nnU-Net for 3D volumetric medical images, so these limitations may not be relevant to them. ...

January 17, 2026 · 5 min · Kumar Abhishek