In my opinion, chaplains exist to disciple and promote faith of some sort, usually in a deity.
Atheists, at least broadly, reject belief in deities to my understanding, although not belief itself. Atheism seems pretty broad from what I know and is not necessarily one set of beliefs. Therefore I don't think so. I believe they should provide counselors and support groups for anyone who needs them, but its not quite the same thing.