WalkerWiki - wiki.alanwalker.uk

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Check Compact SP Deployment Proxy Setting in case Content Extraction fails ======
<color darkorange>Mar 2023</color>

----
==== Introduction ====
\\ 
This is pertaining to an SP release in LB 5.0.9 (but not necessarily limited to this release) where there seems to be a bug with running Compact Mode and Content Extraction.
\\ 
\\ 
For some reason there is a process called <color #ed1c24>ericsson-stream-processing-content-extraction</color> that is being setup internally with a 'proxy'. The proxy is for comms between the service and whatever calls it in a containerised system, not in a RPM system. The proxy has to be removed, which thankfully is very simple.
\\ 
\\ 
To work out the status of the proxy setting we need to check the status of a service, however to get the latest status of the service we need to restart it, this can be done using the following:
    systemctl restart ericsson-stream-processing-content-extraction
There is no feedback from this command line.
\\ 
\\ 
To check the status of the service use the following:
    systemctl status ericsson-stream-processing-content-extraction
This will give an output similar to the following:
<file>
● ericsson-stream-processing-content-extraction.service - ericsson-stream-processing-content-extraction
   Loaded: loaded (/etc/systemd/system/ericsson-stream-processing-content-extraction.service; enabled; vendor preset: disabled)
   Active: active (running) since Fri 2023-03-10 12:32:56 UTC; 56s ago
 Main PID: 25250 (bash)
   CGroup: /system.slice/ericsson-stream-processing-content-extraction.service
           ├─25250 /bin/bash -c cd /opt/ericsson/stream-processing-content-extraction/lib; dotnet ContentExtraction.dll --urls 'http://+:8082'
           └─25251 dotnet ContentExtraction.dll --urls http://+:8082

Mar 10 12:32:56 env-4e-966427 systemd[1]: Started ericsson-stream-processing-content-extraction.
Mar 10 12:32:57 env-4e-966427 bash[25250]: {"time":"2023-03-10T12:32:57.4401338Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"ContentExtraction.Startup","msg":"Proxy mode enabled."}
Mar 10 12:32:57 env-4e-966427 bash[25250]: {"time":"2023-03-10T12:32:57.4607425Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"ContentExtraction.Startup","msg":"Creating interface discovery client for http://localhost:8200/api/discoveries"}
Mar 10 12:32:57 env-4e-966427 bash[25250]: {"time":"2023-03-10T12:32:57.4681028Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"ContentExtraction.Startup","msg":"Enabling housekeeping. Idle time set to 00:02:00 [Checked every 00:01:00]"}
Mar 10 12:32:57 env-4e-966427 bash[25250]: {"time":"2023-03-10T12:32:57.4905264Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"Microsoft.Hosting.Lifetime","msg":"Now listening on: http://[::]:8082"}
Mar 10 12:32:57 env-4e-966427 bash[25250]: {"time":"2023-03-10T12:32:57.4906887Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"Microsoft.Hosting.Lifetime","msg":"Application started. Press Ctrl+C to shut down."}
Mar 10 12:32:57 env-4e-966427 bash[25250]: {"time":"2023-03-10T12:32:57.4907296Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"Microsoft.Hosting.Lifetime","msg":"Hosting environment: Production"}
Mar 10 12:32:57 env-4e-966427 bash[25250]: {"time":"2023-03-10T12:32:57.4907808Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"Microsoft.Hosting.Lifetime","msg":"Content root path: /opt/ericsson/stream-processing-content-extraction/lib"}
</file>
The important line here is about halfway down and ends with:
    "ContentExtraction.Startup","msg":"Proxy mode enabled."}
If we see the text <color #ed1c24>Proxy mode enabled</color> then Content Extraction will fail.
\\ 
\\ 
To rectify this we need to edit just one file, the file is located in the following location:
    cd /opt/ericsson/stream-processing-content-extraction/lib

In this location find the file <color #ed1c24>appsettings.json</color> and open it in your favourite text editor (or vi).
\\ 
\\ 
Around 5 lines from the bottom of the file we will see the entry <color #22b14c>"enabled": "true",</color>
<file>
  "houseKeepingFrequency": "00:01:00",
  "allowedIdleTime": "00:02:00",
  "proxy": {
    "enabled": "true",
    "interfaceDiscoveryAPI": "http://localhost:8200/api/discoveries",
    "serverOfLastResort": ""
  }
}
</file>
We need to set this to "<color #22b14c>enabled": "</color><color #ed1c24>false</color><color #22b14c>",</color>
\\ 
\\ 
Save the file and we can test the result.
\\ 
\\ 
First restart the <color #ed1c24>ericsson-stream-processing-content-extraction</color> process
    systemctl restart ericsson-stream-processing-content-extraction
There is no feedback from this command line.
\\ 
\\ 
To check the status of the service use the following:
    systemctl status ericsson-stream-processing-content-extraction
This will give an output similar to the before, but hopefully with a different output:
<file>
● ericsson-stream-processing-content-extraction.service - ericsson-stream-processing-content-extraction
   Loaded: loaded (/etc/systemd/system/ericsson-stream-processing-content-extraction.service; enabled; vendor preset: disabled)
   Active: active (running) since Fri 2023-03-10 12:40:41 UTC; 1min 26s ago
 Main PID: 14277 (bash)
   CGroup: /system.slice/ericsson-stream-processing-content-extraction.service
           ├─14277 /bin/bash -c cd /opt/ericsson/stream-processing-content-extraction/lib; dotnet ContentExtraction.dll --urls 'http://+:8082'
           └─14278 dotnet ContentExtraction.dll --urls http://+:8082

Mar 10 12:40:41 env-4e-966427 bash[14277]: {"time":"2023-03-10T12:40:41.8481400Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"ContentExtraction.Startup","msg":"Registering with interface discovery ETCD at http://10.43.30.119:2379"}
Mar 10 12:40:41 env-4e-966427 bash[14277]: {"time":"2023-03-10T12:40:41.8482294Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"ContentExtraction.Startup","msg":"Registering server name SP02"}
Mar 10 12:40:41 env-4e-966427 bash[14277]: {"time":"2023-03-10T12:40:41.8482662Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"ContentExtraction.Startup","msg":"Registering interfaces eth2,eth3,eth4,eth5,eth0,eth1"}
Mar 10 12:40:41 env-4e-966427 bash[14277]: {"time":"2023-03-10T12:40:41.8482890Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"ContentExtraction.Startup","msg":"Registering location http://10.43.30.116:8082"}
Mar 10 12:40:42 env-4e-966427 bash[14277]: {"time":"2023-03-10T12:40:42.1093990Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"ContentExtraction.Startup","msg":"{ \"header\": { \"clusterId\": \"5149675153761732660\", \"memberId\": ...tTerm\": \"834\" } }"}
Mar 10 12:40:42 env-4e-966427 bash[14277]: {"time":"2023-03-10T12:40:42.1135477Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"ContentExtraction.Startup","msg":"Enabling housekeeping. Idle time set to 00:02:00 [Checked every 00:01:00]"}
Mar 10 12:40:42 env-4e-966427 bash[14277]: {"time":"2023-03-10T12:40:42.1654125Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"Microsoft.Hosting.Lifetime","msg":"Now listening on: http://[::]:8082"}
Mar 10 12:40:42 env-4e-966427 bash[14277]: {"time":"2023-03-10T12:40:42.1658391Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"Microsoft.Hosting.Lifetime","msg":"Application started. Press Ctrl+C to shut down."}
Mar 10 12:40:42 env-4e-966427 bash[14277]: {"time":"2023-03-10T12:40:42.1658854Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"Microsoft.Hosting.Lifetime","msg":"Hosting environment: Production"}
Mar 10 12:40:42 env-4e-966427 bash[14277]: {"time":"2023-03-10T12:40:42.1659130Z","host":"env-4e-966427","appname":"Content Extraction","pri":"INFO","subsys":"Microsoft.Hosting.Lifetime","msg":"Content root path: /opt/ericsson/stream-processing-content-extraction/lib"}
Hint: Some lines were ellipsized, use -l to show in full.

</file>
Now we can see that the Proxy enabled is missing, and there are a bunch of lines that end with <color #ed1c24>"Registering xxxx"</color> 
<file>
"Registering with interface discovery ETCD at http://10.43.30.119:2379"}
"Registering server name SP02"}
"Registering interfaces eth2,eth3,eth4,eth5,eth0,eth1"}
"Registering location http://10.43.30.116:8082"}
</file>
We can see the VIP of the MKSP units, the server name etc, so this means that comms are now good. You can now retry the Content Extraction.
\\ 
\\ 
<color #ed1c24>**** DONT FORGET TO DO THIS ON BOTH MKSP UNITS ****</color>