When I was little, I liked pickles. That is, until one day when I was about 4 years old and for some reason threw up after eating them. That bad experience was enough to get me to not touch them again until I was about 16. I had one on a cheeseburger. Not as terrible of an experience, but still didn't like them. Then when I was 25, I tried them again. This time I loved them. I still eat them quite frequently. I'm glad I tried them again.
Many people have a pickle experience with Christianity. They think it's okay for a while, but then they have a really bad experience with a church or a person claiming to be a Christian. Some even relent to one more try at a church and have an experience that is mediocre at best. But I believe that if they will choose to try it again, with people who really seek to live by the Bible and be like Jesus, they'll find that they love it and will want to come back frequently. They'll be so thankful that they gave it another go.
The thing is, Christians, we've got to be people that do actually seek to live by the Bible and be like Jesus! Give them something they'll want to taste. The Bible says "O taste and see that the Lord is good." (Psalm 34:8) If our lives don't show a goodness worth tasting, then why would they want to know anything about it? If you believe the Lord is good, then share that goodness (LOVE) with others. Give them a taste of the goodness of the Lord. It is His kindness that leads mankind to repentance (Romans 2:4), and you are the messenger of that kindness to the world.