We had similar issues with the fast forward/rewind functions on YTTV with a Roku player early last year and I ended up buying the Apple TV 4K. Expensive, but great streaming player and very fast. We get 200 mbps streaming and it never buffers.
Originally had some similar problems with the Siri remote that comes with Apple TV with fast forward/rewind using the Siri remote touchpad, but programmed my Onkyo receiver remote to control the Apple TV instead (hard buttons to FF and Rewind on DVR instead of touchpad) and it works great.
In short, I've found that using a non-touchpad remote with the Apple TV to control the YTTV DVR works almost flawlessly for both FF and Rewind. In fact, can't think of one issue I've had with our YTTV DVR under this setup this entire year.
We use the DVR all the time, and I've found I actually now prefer it to the HD DVR we used to have with Dish — it's been that reliable, and you don't have to pay an equipment rental fee, which saves $25-30/month with 3 TVs.
GO COUGS.