Justice Minister nominee Kim Seung-won withdrew his nomination Friday, 20 days after being tapped for the post, saying he did not want controversy surrounding him to become a burden on the Lee Jae Myung administration.