While Modest! Management’s Richard Griffiths continues to rep One Direction five years into the group’s career, rumors are swirling about a defection of the four remaining members as they prepare to launch solo careers.

These rumors went into overdrive during a livestreamed interview with Irving Azoff for Callaway Golf’s Callaway Live, during which he was introduced as the manager of Harry Styles, Liam Payne, Louis Tomlinson and Niall Horan, although Azoff made no comment about this purported coupling during the ensuing Q&A. The story was first reported by teen-celeb site J-14.

Much of the speculation has centered on Styles’ friendship with CAA agent Jeffrey Azoff; the two are frequently seen around L.A. together. As I.B. Bad points out in his latest column, the younger Azoff’s deal with the agency is up at the end of October, and going to work with his father at Azoff Management is obviously one of his options.

Will rumor become reality? That remains to be seen.