Install the latest nvidia drivers ('game ready' will work).
Switch the T4s into MCDM mode to get them working in WSL and showing in task manager.
From an administrator terminal:
nvidia-smi -dm 2
To switch them back to TCC mode (untested, not sure why I...