Hi Kevin,
Ok so in the context of audio hardware, latency actually refers to the internal buffer size that the audio hardware uses to record/playback music. The smaller you make that number the smaller the buffer size is and the smaller the latency.
The lower the latency, the more processing your computer has to do because it has to swap buffers more often which is computationally expensive. If your computer is unable to keep up with swapping these buffers often enough you will start to experience issues like audio looping and skipping and jerky playback and recording.
A higher latency is easier for your computer to handle, but it comes at the cost of adding a time lag to your playback. What this means is that when you are playing your track and you make some changes to something like the volume or pan or an effect, you will not hear those changes until the next buffer swap.
If I recall correctly, the maximum latency setting on the fast track is only around 250ms or something like that. So even with it set to the maximum you are unlikely to experience many serious problems. Really low latency is most important for live performance products like DJ programs.
As a note, it doesn't matter what your latency settings are in regard to having correctly sync'd recording and playback. That should work regardless.
So we know we're on the same page here, can you describe the latency problem you are having?
Regards,
Ben