Ben Carson and his wife were fully aware