The signature is set up by clicking on the User badge on the top right corner and clicking on Personalize. If the reply notifications have a variable $EmailSignature under Admin >> Notification Rules, then the signature will be automatically appended. You can remove the variable to avoid this.