Lee Seo Jin Rejects Ghosting Rumors