TensorFlow on Windows seems like a no-brainer. Support for GPU-accelerated applications on Windows is highly robust, and Windows is as popular a platform as you could ask for.