Staying Topical Going Deep