When should I put a link back to a domain that backlinked to mine?

Be careful of this. Reciprocal links are frowned upon by Google, so unless you’re doing it as a natural link from your website or content, avoid it. Link to other sites because it makes sense to, not because you agreed to or because they linked to you.