If the old URLs have a pattern (e.g., under a specific subsite), then you can add the URL pattern to the "Excluded sites" (accessible via the Sites page in your CSE control panel).  Even if you don't have a good pattern, you can still add individual urls there to exclude, which should be enough for your use case.