Don't Take Official Records With You
Official records belong to the Government and must remain in the custody of the Agency. There are Agency guidelines that permit you to remove extra copies of records or other work-related, non-record materials. However, copies of records that are classified or otherwise restricted (e.g., under the Privacy Act, subject to privilege ) must be maintained in accordance with Agency requirements.
The Government has authority to enforce recovery of any unlawfully removed, altered or destroyed records.
Of course, you can remove personal materials,such as family and personal correspondence, as long as they aren't official records. If you have questions, talk with the records officer in your office.