Try the program MidiPipe by Subtlesoft (Mac only) or some Windows equivalent software. A midi pipe type of program will take whatever controller you have and convert the messages into whatever other messages you'd like to send. Low latency. It even has an AppleScript Trigger plugin that allows you to run some script and do your own transformations of the message as it comes in. I currently have my own tuning code that I use and it is still low latency. Try the program out or some Windows equivalent and see how it does.

It worked, way less latency and was able to lose the midi usb hardware. Awesome thanks for your help

Perhaps you could do the same without another application with IAC driver included in macOS:

https://support.apple.com/guide/audio-midi-setup/transfer-midi-information-between-apps-ams1013/mac

For a cross operating system solution, see also:

https://sourceforge.net/projects/midi-router-client/