Keep email history when replying.

Is it possible to keep the email history when replying to a case and is there any configuration that has to be made.