This is happening in Fatawak Bay but of course that's only as far as I've progressed. What happens is the yellow icons over the fish disappear groupers but also other fish and they become uneatable. You can't interact with them. This is happpening on the Nintendo Switch. This happens occasionally but frequently.