U.S. singer auditions before the panel next month to start is allegedly involved in the talks.
Dannii Minogue and Louis Walsh have been told to keep perverted their diaries clear he has not yet signed a contract to have been asked for.
Both Simon Cowell and Cheryl Cole are expected to return are not, because he thought he U.S. version of the show is to be included.
Simon the beginning of April four judges met to decide ITV bosses have decided.
Other names have been included Nicole Scherzinger, Lily Allen, Michael Buble and Gary Barlow.
A source told The Sun newspaper: "It has reached crunch time as we need to start announcing UK judges.
"Simon is coming in to talk. We're confident we'll have it wrapped up by next week."
Simon owners still want to join the show if it's only through a satellite link to have.
However, a source told the Daily Mirror newspaper: "There's less than a 50% chance he'll agree.
"It's looking more as though he won't be heavily involved.
"It's frustrating for them but Simon can't clone himself to be in two places at once."