There's a "realtime" kernel available for Linux that improves timing - no idea if this would help in this situation. See: linux-image-rt-amd64 in debian, for instance