A life lesson I have gained: 

If people speak ill of you and this leads to others avoiding you just because of what they have heard, then give thanks to God for the ones who speak ill. 

They are doing you a great favor. 

They are helping to sift out the fools from your life so you do not have to suffer them.