====== Check 1+1 SP Comms ======
Apr 2021
----
==== Introduction ====
\\
The 1+1 SPs communicate with each other over the Management network using various ports, these are:
15771 for Mux comms
15772 for Simulcrypt
15778 for stat Mux
\\
We can use tcpdump to monitor the traffic between the Muxes by specifying the relevant port.
\\
tcpdump -i mngt port 15778 -Q out
\\
This will show Stat Mux traffic (as in the stat mux control messages).
\\
\\
The active Mux will show something like below:
tcpdump -i eth0 port 15778 -Q out
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth0, link-type EN10MB (Ethernet), capture size 262144 bytes
15:49:22.309719 IP sp01.15778 > 235.2.127.254.15778: UDP, length 61
15:49:22.851978 IP sp01.15778 > 235.2.127.254.15778: UDP, length 61
15:49:23.394021 IP sp01.15778 > 235.2.127.254.15778: UDP, length 61
15:49:23.936007 IP sp01.15778 > 235.2.127.254.15778: UDP, length 61
15:49:24.478037 IP sp01.15778 > 235.2.127.254.15778: UDP, length 61
15:49:25.019993 IP sp01.15778 > 235.2.127.254.15778: UDP, length 61
15:49:25.562039 IP sp01.15778 > 235.2.127.254.15778: UDP, length 61
15:49:26.104193 IP sp01.15778 > 235.2.127.254.15778: UDP, length 61
15:49:26.646276 IP sp01.15778 > 235.2.127.254.15778: UDP, length 61
15:49:27.188263 IP sp01.15778 > 235.2.127.254.15778: UDP, length 61
\\
Where as the inactive mux will have no tcpdump output
\\
tcpdump -i eth0 port 15778 -Q out
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth0, link-type EN10MB (Ethernet), capture size 262144 bytes
\\
If we look at the Mux Comms on 15771 then we see activity from BOTH Muxes:
On the Main Mux
tcpdump -i eth0 port 15771 -Q out
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth0, link-type EN10MB (Ethernet), capture size 262144 bytes
15:58:10.290160 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
15:58:10.790638 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
15:58:11.290752 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
15:58:11.791356 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
15:58:12.291375 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
15:58:12.791417 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
15:58:13.291816 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
15:58:13.792613 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
15:58:14.293486 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
15:58:14.793887 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
\\
On the Backup Mux
tcpdump -i eth0 port 15771 -Q out
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth0, link-type EN10MB (Ethernet), capture size 262144 bytes
15:58:10.255915 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
15:58:10.756223 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
15:58:11.256603 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
15:58:11.756856 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
15:58:12.257007 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
15:58:12.757740 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
15:58:13.258254 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
15:58:13.758822 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
15:58:14.259383 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
15:58:14.760368 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
\\
Unfortunately both outputs look the same, but if we add -A to the command line, so:
\\
\\
tcpdump -i eth0 port 15771 -Q out -A
\\
\\
We see the following:
\\
From the MAIN Mux
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth0, link-type EN10MB (Ethernet), capture size 262144 bytes
16:02:20.064957 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
E....6@.@..W........=.=....]{
"uid": "SP01",
"groupName": "mux_mux_52_1_1",
"startTime": 1617895607872,
"removed": false,
"privateData": {
"oldest": true,
"transmitting": true
},
"cc": 134
}
16:02:20.565987 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
E....]@.@..0........=.=....]{
"uid": "SP01",
"groupName": "mux_mux_52_1_1",
"startTime": 1617895607872,
"removed": false,
"privateData": {
"oldest": true,
"transmitting": true
},
"cc": 135
}
16:02:21.066788 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
E... .@.@...........=.=....]{
"uid": "SP01",
"groupName": "mux_mux_52_1_1",
"startTime": 1617895607872,
"removed": false,
"privateData": {
"oldest": true,
"transmitting": true
},
"cc": 136
}
16:02:21.566860 IP sp01.15771 > 235.2.127.254.15771: UDP, length 207
E...!.@.@...........=.=....]{
"uid": "SP01",
"groupName": "mux_mux_52_1_1",
"startTime": 1617895607872,
"removed": false,
"privateData": {
"oldest": true,
"transmitting": true
},
"cc": 137
}
\\
From the BACKUP Mux
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth0, link-type EN10MB (Ethernet), capture size 262144 bytes
16:02:20.027155 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
E...j"@.@..h........=.=....`{
"uid": "SP02",
"groupName": "mux_mux_52_1_1",
"startTime": 1617895627134,
"removed": false,
"privateData": {
"oldest": false,
"transmitting": false
},
"cc": 135
}
16:02:20.527548 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
E...j.@.@...........=.=....`{
"uid": "SP02",
"groupName": "mux_mux_52_1_1",
"startTime": 1617895627134,
"removed": false,
"privateData": {
"oldest": false,
"transmitting": false
},
"cc": 136
}
16:02:21.028483 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
E...k.@.@...........=.=....`{
"uid": "SP02",
"groupName": "mux_mux_52_1_1",
"startTime": 1617895627134,
"removed": false,
"privateData": {
"oldest": false,
"transmitting": false
},
"cc": 137
}
16:02:21.528890 IP sp02.15771 > 235.2.127.254.15771: UDP, length 209
E...mZ@.@..0........=.=....`{
"uid": "SP02",
"groupName": "mux_mux_52_1_1",
"startTime": 1617895627134,
"removed": false,
"privateData": {
"oldest": false,
"transmitting": false
},
"cc": 138
}