Diamond doesn’t have the best absorption spectrum compared to high quality optical glass. You’d end up losing more light.

Pretty sure the lines of cleavage would make it pretty difficult to get a useful lense shape made out of the stuff.