Cobain said the song is about a man who, after the death of his girlfriend, turns to religion "as a last resort to keep himself alive. To keep him from suicide". http://bit.ly/9vTM92
To me Lithium is saying that we are not perfect, but we are perfect for each other. It also seems like this love that Kurt speaks of was pushed away and that he had pushed her away.
