Is the Gospel Annoying?

Peter and John took Jesus' great commission to them and ran with it. They preached the Gospel of Christ with great passion and without apology. The promised Holy Spirit had come and set their hearts and tongues on fire.

The Captain of the Temple and the Sadducees, however didn't like it. They were greatly annoyed (Acts 4:2) that these mere fishermen were preaching about Jesus in the Temple. Why? Probably because the people were actually listening. So, what did this Captain and the Sadducees do? They had Peter and John thrown into jail overnight. Did that stop the people from coming to Christ? Nope. Over 5,000 men (not to mention women and children) came to Christ in spite of their preachers being arrested.

So, since the Gospel is apparently annoying, here's the question. Is it wrong to annoy people by telling others about Jesus? Should we be concerned about offending others with the Gospel and risk being labeled "intolerant" or "radical" or "politically incorrect"? Or even "annoying"? What do you think?

~

"And as they were speaking to the people, the priests and the captain of the temple and the Sadducees came upon them, greatly annoyed because they were teaching the people and proclaiming in Jesus the resurrection from the dead. And they arrested them and put them in custody until the next day, for it was already evening. But many of those who had heard the word believed, and the number of the men came to about five thousand." 
~ Acts 4:1-4, ESV