Benjamin Banneker, Bullis and Wakefield