Kanye West had a great idea after girlfriend Kim Kardashian gave birth to the couple’s daughter North West in July: why didn’t Kardashian start her own kid-targeted clothing line.

It made sense, Kardashian, 32, had always been interested in fashion, they had a new baby to dress as fashionably as possible and it offered her the perfect opportunity to push away from her mother and her reality TV past.

A dress for Baby North designed by Alexander Wang.kimkardashian/Instagram

West, 36, even arranged meetings for her with fashion friends like editor Carine Roitfeld and Givenchy designer Riccardo Tisci.

But then, things took a turn, and what started out as a nice idea turned into a sore subject for the couple.

“[West] opened doors for [Kardashian] where they were once shut, which is great,” a source told Radar Online, “but now he’s giving her his two cents on everything and it’s driving Kim crazy. The truth of the matter is that he doesn’t think Kim has good style and he knows whatever she produces will be a direct reflection on him. He doesn’t trust her to do her own thing.”

West — who’s never shied away from letting his artistic vision be known — decided he didn’t like how the clothes were coming, and months after giving Kim a makeover, decided to do the same to her ideas.

West reportedly wants Kardashian’s designs to take inspiration from Givenchy, Alexander Wang and Lanvin, which Kardashian is fine with, but she also wants it to be clear that their daughter is her “muse.”

The diverging ideas about how the clothes should look and their daughter should be dressed, eventually caused Kim to speak up.

“Kim joked to Kanye that he should give up music for a full-time job in fashion but it didn’t go over well,” the source told the gossip site. “Nobody, including Kim, speaks to Kanye like that, especially if they don’t want to see his temper. Kanye snapped at her over it.”

Despite their disagreement, Kardashian is still making clothes for baby North, with hopes of launching her own line within the year.