We know he had a boy he considered to be his brother in Root, who either a.) died of an illness or b.) was killed by Sai as part of an initiation test.