Intrusive images during imagine scenes

Ok so I have a question, sometimes when I imagine during the day, for example I imagine me and my sp kissing then suddenly I get the image of a 3rd party and it creates some fear in me.. not always but sometimes and now I am worried that maybe I am manifesting something that I dont want because my brain is inserting this.. anyone can tell me of they had this and still had successfully manifested the outcome?