Neil Diamond savored the moment as he played his first public concert in his native Brooklyn on Thursday night.