This is due to a Cell Border that is put around each color in order to distinguish each group. When you have many different colors, the screen cannot show all the colors along with the cell border.
You can eliminate the cell border (as shown below) by choosingCustomize | Hide ColorBar Cell Borders from the Task tab of the View Controller.