More likely the mods caught up with the scammer. I don't think you can delete the other party's copy of your conversation.
If you were the scammer and "Leave Conversation" I would no longer see your message, but my message back to you would still be viewable to me.