Even Christians still struggle with things like pride and foolishness which Jesus said came out of our heart. It's certain that our born again spirit is not the source of these sins. The heart includes more than our spirit.
The English word "soul" comes from the Greek translated "heart, life, mind, and soul." The mind is the leading part of the soul, followed by the will and emotions. We could also describe the soul as being the hidden part of all existing beings or what most people would call the personality. The soul is the center of the feelings and emotions, appetites and desires, as well a perception and consciousness. The soul may also speak of the total person - his total being or self, a person, and the hidden man or inward man.
The soul and the body do not get born again. It is the spirit of man that becomes totally new at salvation. So, although every believer receives the same miraculous spiritual rebirth, the visible results of that inward change will vary from person to person according to how much he renews his mind. The term "heart" can include all of the inner man - spirit, soul, or any portion of it. The peace of God will keep our heart at rest in Christ Jesus.