Here's a more informative list with the readings of AU Lab. These were made a year ago or so with an older Firmware and driver though, so values could have changed (there was an overhaul of the OS X driver for both the FF and UC).
"Hardware" means ADC/DAC conversion plus some internal processing/buffer offset that is *not* the Safety Buffer.
Input OS X 10.5
HDSPe: Hardware 45, Safety Offset 24
FF 400: Hardware 45, Safety Offset 64
FF UC: Hardware 45, Safety Offset 24
Output OS X 10.5
HDSPe: Hardware 79, Safety Offset 24
FF 400: Hardware 32, Safety Offset 64
FF UC: Hardware 46, Safety Offset 24
These are the latencies your interface begins with *without* audio buffers being added. So in the above example a Fireface UC with a buffer setting of 64 samples would sum up to 46 + 24 + 64 = 134 samples = 3.04 ms output latency.
And yes, the complete round-trip latency is just as you calculated. Windows seems to have a slight edge here, but it's rather small and you have too keep in mind that OS X allows to use audio buffers down to 16, while the lowest in Windows is 48.
With the current drivers the audio-buffer size is doubled when you double the sample-rate, I don't know about the safety-buffer though. The "Hardware" part is mostly ADC/DAC (except for the HDSPe output and FF input on OS X) so it should not change. The latter values are listed in the manual for all sample-rates (in ms).