Eli was born, and raised in New York City. His mother is Austrian-Hungarian Jewish and his father is from an old New York New England family. He attended Saint Ann's School in Brooklyn Heights where he was exposed in depth to the arts. He also studied at the School of American Ballet at Lincoln Center.