Gaming with linux server through zero/thin client (No VM, like Xrdp)

Question

Over a local network with about 1 gigabit connection, Im wanting to start a Linux X session within a server that streams with low latency to a zero (Or if not possible, thin) client, controlling remotely, and forwarding usb storage devices (If possible) and audio. Not to be confused with running a VM within the server. My question is, how do I do this, what hardware and software would this require, and how would I set this up?

Ive attempted using Xpra, although some looks promising, there is a lot of problems involved, specifically related to 3D graphics and Wine, not supporting all features a normal/local install might.

I would assume zero clients have a strict set of common built in protocols, since I doubt they would be build for high video throughput needed by gaming, I may have to use a thin client.

Please try use easy language as I am not adept in this field at all