And in a desperate bid to keep her on the show, Simon Cowell has reportedly offered to double the Girls Aloud star’s £1.2million salary.
But Cheryl has allegedly told Simon her decision is not about money. Well she has got plenty of the stuff already we suppose.
"Cheryl has so much else going on in life” said a source.
"The number one thing on her mind is starting a family. The show is a huge commitment. It's six months of the year. Cheryl wanted to have a baby with Ashley this year but put it off because of work.
"She doesn't want to wait much longer and she's not keen on having to judge The X Factor while she's heavily pregnant."
But despite her plans to start a family, Cheryl will definitely be sticking with her obligations to record an album with her band Girls Aloud next year.
So will you miss Cheryl, and who would you like to see replace her if she does indeed quit the programme?