Don't Participate in Official Matters That Affect Your Future Employer
When you are seeking employment, you can't work personally and substantilally on any particular matter that directly and predictably affects the financial interest of the prospective employer(s). This means that you have to be careful about any particular matter including specific party matters (e.g., contracts, grants, enforcement actions) as well as any matter of general applicability (e.g., any matter that affects the employer as a memeber of a class).
The important point to remember is that the interests of your prospective employer are imputed to you for the purposes of the criminal conflict of interest statute under 18 U.S.C. 208. In other words, their interests become your interests.
If you are seeking employment, you are obligated to recuse yourself from any participation in any particular matter that affects your potential future employer. If there's no particular matter in your office that affects your potential future employer, then you have have fulfilled your recusal requirement.