Known for his curt remarks, Cowell said that he can't make up his mind about Abdul. "Paula's frustrating, she's annoying and I can't understand half of what she's talking about -- but there's incredible comfort between us," Us magazine quoted him as telling TV Guide. He added: "I think we're possibly secretly in love with each other."
However, he doesn't share the same warm feelings for other judge Kara DioGuardi. When asked if the fourth judge will be back next year, Cowell said: "I would imagine so. The only say I have is about Ryan (Seacrest), Randy (Jackson) and Paula. I've always made it clear that I wouldn't like to do the show without them."
However, Cowell, who also judges on 'The X-Factor' and 'Britain's Got Talent', may not be around to see another season of 'Idol'.
"I think nine seasons is a lot. I've had the best time ever in my life, and then you consider doing something new or taking a break," he said.