One of the five men who accused former Elmo puppeteer Kevin Clash of underage sex has dropped his lawsuit in New York, saying he wants to focus on his career instead.