Kody Brown and his wife, Robyn Brown, are leaving the cast of “Sister Wives” after 16 years and 20 seasons.