Spd-Sx MIDI latency problem

[soilworker24]

Hi!
I have a new Spd-Sx and I want to use it as a midi for my DAW.
But when i try to use it, it has a really annoying latency.
The only way I can use it without latency is if I decrease my buffer size to 32, but when I play the project (to record drums on it with the Spx-Sx) It gives me a lot of white noise that increases over time.
How do I get rid of that latency? maybe it isn't synced good with the DAW or something else?
BTW I use FL-studio.
Thanks in advance!