Should I send him a Father's Day card?

No. Do not send him a card. There is no purpose to it other than opening up communications. If he was your childs father then yes.