A source claimed the two have been having a rough patch for awhile now.