[jpirko/libteam] 6c8d2e: teamd: fix port removal when using take_over