Goss hails from Akerman, Mississippi. He was an 11th round draft pick of the Boston Redsox in the 2002 amateur draft, coming out of Jackson State University. He would have went much higher in the draft but teams were worried about his sign-ability due to his NFL potential as a Kick returner. Goss was sent to the Arizona Diamondback during 2003 in the trade that brought Curt Schilling to Boston. In 2004 he played for El Paso in the Texas League. From 2005-2008 he played for various Independent League teams. He has a career batting average of 292 with 211 RBIs.