I've had people give me grief about giving money. My response?

What the receiver does with it is between them and their god. I've done what my God has commanded of me.

That usually shuts them up.

When we all die we answer for no one's deeds but our own.