The Apple TV remote can do more than you think.
The fix was on my desk the whole time.