When using the Search Agent over TCP/IP (ie manual installation) most firewalls, including Windows Firewall, will by default request confirmation that such communication is allowed. Here's an example for Windows Firewall:
The program that does the actual Search Agent communication, called flr_client.exe, needs to be unblocked for the Search Agent to function correctly.