When a player blows up a mine, put a marker in that location on the map and minimap. When, say, 95% of the gems that came out of that mine have been collected, remove the marker.

I often lose track of gem clusters because I want to get on with it and kill things instead of waiting for everything to drop. I'll eventually randomly encounter them again anyway, but with markers like this I can plan my route to collect them on purpose.