I prayer daily for faith, patience and understanding

I am in a fairly new relationship with a man that was previously married. Recently his ex wife found out we were taking a trip out of the country, and felt obligated to call and email me to tell me that I am not the only women in his life. I never had any reason to not trust him, but now she has gotten in my head and I am second guessing our relationship and afraid I am going to ruin things with my own doubt. I prayer daily for faith, patience and understanding but am letting this get the best of me.