We have a Linux (debian) server that has two NICs that are connected to the same switch. (We used to have a switch dedicated for traffic between our servers but when most of our servers moved to a colo facility that switch moved as well.) These NICs have different static IP addresses but about once a month arpwatch will send out a pair of flip flop messages as one of the IPs bounces from one interface to the other and back. What could be causing this?
These will cause ARP replies to only go out on the network interface that actually owns the IP address being requested in the ARP request.
As mentioned in the above-referenced question this is because by default in Linux the host owns an IP, and not a particular interface, so the replies will go out on whatever interface it chooses. This can cause problems when you have multiple interfaces on the same network and is exactly what the above sysctl parameters modify.