I've experimented with similar previously, we had Pointcloud data with RGB values on it. I converted those values to HSV and used these along with the RGB values to filter out points that were sufficiently 'grey' (high saturation). Similar logic also allowed us to pull out white and yellow line markings with some success