Dulaney Valley Memorial Gardens opened a section known as The Garden of Innocents in 1960. The garden was created to provide parents with a beautiful, inexpensive resting place for young children. At a later date, when the family is in a better financial position to purchase a lot at Dulaney Valley, the family may reinter their infant on their own lot.

A blithe and happy child known as the "The Duck Girl" sits surrounded by geese in the center of the Garden of Innocents. The bronze is the work of Bernard Zuckerman, of the Pompeian Studios, located in New York City. On its base is a bronze tablet with a selection from "The Little Sandman's Song", an English translation of the German version written by Louis Untermmeyer.