Add gestures & focus together in a ViewController in tvOS

I have a Video Player screen in my tvOS app. In it, I have Swipe, Pan & Tap gestures registered for Seeking the video and take Siri remote's button actions.

I am able to bring focus to any single button when the screen is loaded by specifying the button in preferredFocusEnvironment() function. But, when I added more buttons to the viewcontroller, I am not able to move focus from one button to another by default. Because, the gestures snatch the control away whenever we try to change focus from a button to another.

So, is there anyway we can include focus & multiple gestures in the same viewcontroller so that both should be supported ?