Decklink SDI input

So, I just finished a show using 5 v3.2 servers, and two of these were used with Decklink PRO cards, using the SDI input. Now, when I would switch to video input, one of the servers had a 1-3 second delay from the switcher in the truck. Does anyone have any ideas as to why this would happen?