James was the son of unknown parents. The date and place of his birth have not been found.
His wife was Dorothy Mancuso, who he married in ABT 1940. The place has not been found. Their three known children were Jim Jr (?-?), Billy Joe (?-?) and Mary Jane (?-?).