Well, I think that Crane is talking about the way that many people feed their own suffering. The creature likes that his heart is bitter, it enjoys its own misery and resentment. It wallows in its bitterness. I think that may also be why Crane refers to it as a creature - he may feel that such people fail to be human.

That's just what I get from it though.