The answer is: The poignancy of the lines comes from the thought that the beauty of a human can go unappreciated by anyone.
In the poem "Elegy Written in a Country Churchyard," which is a meditation on death, the author Thomas Gray makes reference to gems hidden in the ocean and flowers blooming out of human sight. Thus, he refers to the beauty and virtue of the people buried in the cemetery, who have simple tombs and have not been honored.