J Dilla's Brother Illa J Argues That Kanye Wouldn't Be as 'Big as He Is' If Producer Was Still Alive Ye and Dilla worked together before the Detroit producer's untimely death in 2006.