error with nginx while running on kubernetes

[RuneRoven]

Hi. I was trying to install the platform in my kubernetes cluster running k3os..
I downloaded the repository and run the helm install. All pods starts up but in the UI node i get:
nginx: [warn] the "user" directive makes sense only if the master process runs with super-user privileges, ignored in /etc/nginx/nginx.conf:17
2023/02/05 17:10:41 [emerg] 1#1: bind() to 0.0.0.0:80 failed (13: Permission denied)
nginx: [emerg] bind() to 0.0.0.0:80 failed (13: Permission denied)

I have changed the pod port in the helm charts to 8030 but i still get the same error.. i would like to run on another port anyway since i have other pods in the cluster. No pod is using port 80 atm but probably i will use it in the future for other stuff..
Not sure on how to fix this without compose a new docker and pull since it looks like this is inside the ui compose..

[dominikriemer]

Hi @RuneRoven and welcome!
Which version are you running? Am I correct that you were trying to run the current development version from dev?

[RuneRoven]

looks like there is some connection problem.. consul is running at 8500 and extension is running. this is the log from consul :

and this is from extensions:

[dominikriemer]

Looks like the core/backend service is not properly running. Can you provide these logs as well please? In the beginning of the log, there should be some info on service registration, selected hostname consul status.

[RuneRoven]

22:05:48.233 [main] INFO org.apache.streampipes.commons.networking.Networking - Using auto-discovered IP: 10.42.0.99
22:05:48.531 [main] INFO org.apache.streampipes.commons.networking.Networking - Using default port: 8030
22:05:49.362 [main] INFO org.apache.streampipes.svcdiscovery.consul.ConsulProvider - Checking if consul is available on host consul and port 8500
22:06:02.731 [main] INFO org.apache.streampipes.svcdiscovery.consul.ConsulProvider - Could not connect to Consul instance...
22:06:02.731 [main] INFO org.apache.streampipes.svcdiscovery.consul.ConsulProvider - Retrying in 1 second
....
....
22:09:01.958 [main] DEBUG org.apache.http.wire - http-outgoing-0 >> "Host: consul:8500[\r][\n]"
22:09:01.959 [main] DEBUG org.apache.http.wire - http-outgoing-0 >> "Connection: Keep-Alive[\r][\n]"
22:09:01.959 [main] DEBUG org.apache.http.wire - http-outgoing-0 >> "User-Agent: Apache-HttpClient/4.5.13 (Java/17.0.6)[\r][\n]"
22:09:01.959 [main] DEBUG org.apache.http.wire - http-outgoing-0 >> "Accept-Encoding: gzip,deflate[\r][\n]"
22:09:01.959 [main] DEBUG org.apache.http.wire - http-outgoing-0 >> "[\r][\n]"
22:09:01.959 [main] DEBUG org.apache.http.wire - http-outgoing-0 >> "{"ID":"core-qw7Uj9","Name":"core","Tags":["sys:core","sys:connect-master","sys:streampipes-client"],"Address":"http://10.42.0.99","Port":8030,"EnableTagOverride":true,"Check":{"Interval":"10s","HTTP":"http://10.42.0.99:8030/streampipes-backend/api/svchealth/qw7Uj9","DeregisterCriticalServiceAfter":"120s","Status":"passing"}}"
22:09:02.141 [main] DEBUG org.apache.http.wire - http-outgoing-0 << "HTTP/1.1 200 OK[\r][\n]"
22:09:02.141 [main] DEBUG org.apache.http.wire - http-outgoing-0 << "Vary: Accept-Encoding[\r][\n]"
22:09:02.142 [main] DEBUG org.apache.http.wire - http-outgoing-0 << "X-Consul-Default-Acl-Policy: allow[\r][\n]"
22:09:02.142 [main] DEBUG org.apache.http.wire - http-outgoing-0 << "Date: Mon, 06 Feb 2023 22:09:02 GMT[\r][\n]"
22:09:02.142 [main] DEBUG org.apache.http.wire - http-outgoing-0 << "Content-Length: 0[\r][\n]"
22:09:02.142 [main] DEBUG org.apache.http.wire - http-outgoing-0 << "[\r][\n]"
22:09:02.564 [main] DEBUG org.apache.http.headers - http-outgoing-0 << HTTP/1.1 200 OK
22:09:02.655 [main] DEBUG org.apache.http.headers - http-outgoing-0 << Vary: Accept-Encoding
22:09:02.833 [main] DEBUG org.apache.http.headers - http-outgoing-0 << X-Consul-Default-Acl-Policy: allow
22:09:02.834 [main] DEBUG org.apache.http.headers - http-outgoing-0 << Date: Mon, 06 Feb 2023 22:09:02 GMT
22:09:02.834 [main] DEBUG org.apache.http.headers - http-outgoing-0 << Content-Length: 0
22:09:03.166 [main] DEBUG org.apache.http.impl.execchain.MainClientExec - Connection can be kept alive indefinitely
22:09:03.442 [main] DEBUG org.apache.http.impl.conn.PoolingHttpClientConnectionManager - Connection [id: 0][route: {}->http://consul:8500] can be kept alive indefinitely
22:09:03.443 [main] DEBUG org.apache.http.impl.conn.DefaultManagedHttpClientConnection - http-outgoing-0: set socket timeout to 0
22:09:03.453 [main] DEBUG org.apache.http.impl.conn.PoolingHttpClientConnectionManager - Connection released: [id: 0][route: {}->http://consul:8500][total available: 1; route allocated: 1 of 500; total allocated: 1 of 1000]
22:09:04.227 [main] INFO org.apache.streampipes.svcdiscovery.consul.SpConsulServiceDiscovery - Successfully registered service at Consul: core-qw7Uj9

---

| | |.----.-----.---.-.--------.| __ _|.-----.-----.-----.
| | | | -| _ | || / || _ | -| --|
|||| ||.|||||| ||| ||_|
||
** StreamPipes Core **

2023-02-06T22:10:36.007Z INFO 1 --- [ main] o.a.s.s.c.StreamPipesBackendApplication : Starting StreamPipesBackendApplication v0.91.0-SNAPSHOT using Java 17.0.6 with PID 1 (/streampipes-backend.jar started by root in /)
2023-02-06T22:10:36.043Z INFO 1 --- [ main] o.a.s.s.c.StreamPipesBackendApplication : No active profile set, falling back to 1 default profile: "default"
2023-02-06T22:13:38.327Z INFO 1 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8030 (http)
2023-02-06T22:13:39.815Z INFO 1 --- [ main] o.apache.catalina.core.StandardService : Starting service [Tomcat]
2023-02-06T22:13:39.880Z INFO 1 --- [ main] o.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/10.1.4]
2023-02-06T22:13:50.181Z INFO 1 --- [ main] o.a.c.c.C.[.[.[/streampipes-backend] : Initializing Spring embedded WebApplicationContext
2023-02-06T22:13:50.379Z INFO 1 --- [ main] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 175899 ms
2023-02-06T22:14:09.346Z INFO 1 --- [ main] o.a.s.s.core.StreamPipesEnvChecker : Checking and updating environment variables...
2023-02-06T22:14:12.073Z INFO 1 --- [ main] o.a.s.s.core.StreamPipesEnvChecker : No JWT signing mode provided (using default settings), consult the docs to learn how to provide JWT settings
2023-02-06T22:14:12.074Z INFO 1 --- [ main] o.a.s.s.core.StreamPipesEnvChecker : Updating local auth config with signing mode HMAC
2023-02-06T22:14:13.105Z INFO 1 --- [ main] o.a.s.s.c.utils.CouchDbViewGenerator : Checking if generic database genericstorage exists...
2023-02-06T22:14:19.802Z INFO 1 --- [ main] o.a.s.s.c.utils.CouchDbViewGenerator : Database genericstorage already present
2023-02-06T22:14:20.309Z INFO 1 --- [ main] o.a.s.s.c.migrations.MigrationsHandler : Checking for required migrations...
2023-02-06T22:14:42.317Z INFO 1 --- [ main] o.a.s.s.c.migrations.MigrationsHandler : All migrations completed.
2023-02-06T22:14:42.402Z INFO 1 --- [ main] o.a.s.s.c.StreamPipesBackendApplication : Pipeline health check will run every 60 seconds
2023-02-06T22:14:43.058Z INFO 1 --- [ main] o.a.s.s.c.StreamPipesBackendApplication : Extensions logs will be fetched every 60 seconds
2023-02-06T22:14:47.376Z INFO 1 --- [pool-1-thread-1] o.a.s.s.c.StreamPipesBackendApplication : Checking for orphaned pipelines...
2023-02-06T22:14:49.608Z INFO 1 --- [pool-1-thread-1] o.a.s.s.c.StreamPipesBackendApplication : Found 0 orphaned pipelines
2023-02-06T22:14:49.668Z INFO 1 --- [pool-1-thread-1] o.a.s.s.c.StreamPipesBackendApplication : Checking for gracefully shut down pipelines to be restarted...
2023-02-06T22:14:50.039Z INFO 1 --- [pool-1-thread-1] o.a.s.s.c.StreamPipesBackendApplication : Found 0 pipelines that we are attempting to restart...
2023-02-06T22:14:50.077Z INFO 1 --- [pool-1-thread-1] o.a.s.s.c.StreamPipesBackendApplication : No more pipelines to restore...
2023-02-06T22:15:37.856Z INFO 1 --- [ main] o.s.b.a.w.s.WelcomePageHandlerMapping : Adding welcome page: class path resource [static/index.html]
2023-02-06T22:15:46.770Z INFO 1 --- [ main] o.s.s.web.DefaultSecurityFilterChain : Will secure any request with [org.springframework.security.web.session.DisableEncodeUrlFilter@1b32cd16, org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@4bdcaf36, org.springframework.security.web.context.SecurityContextHolderFilter@267bbe1a, org.springframework.security.web.header.HeaderWriterFilter@759d81f3, org.springframework.web.filter.CorsFilter@61d01788, org.springframework.security.web.authentication.logout.LogoutFilter@1d3e6d34, org.apache.streampipes.rest.filter.TokenAuthenticationFilter@2b9b7f1f, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@389562d6, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@5a101b1c, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@264c5d07, org.springframework.security.web.session.SessionManagementFilter@5a4c638d, org.springframework.security.web.access.ExceptionTranslationFilter@22101c80, org.springframework.security.web.access.intercept.AuthorizationFilter@40021799]
2023-02-06T22:15:54.795Z INFO 1 --- [ main] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8030 (http) with context path '/streampipes-backend'
2023-02-06T22:15:55.073Z INFO 1 --- [ main] o.a.s.s.c.StreamPipesBackendApplication : Started StreamPipesBackendApplication in 389.614 seconds (process running for 627.853)

[RuneRoven]

some errors in the backend:
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)
at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)
at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.base/java.lang.Thread.run(Unknown Source)

2023-02-06T22:24:50.589Z ERROR 1 --- [nio-8030-exec-4] o.g.j.server.ServerRuntime$Responder : Error while closing the output stream in order to commit response.

org.glassfish.jersey.server.ContainerException: java.util.concurrent.ExecutionException: java.lang.NullPointerException: Cannot invoke "String.length()" because "this.input" is null
at org.glassfish.jersey.servlet.internal.ResponseWriter.getResponseContext(ResponseWriter.java:278)
at org.glassfish.jersey.servlet.internal.ResponseWriter.writeResponseStatusAndHeaders(ResponseWriter.java:128)

....
....
...

at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:478)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:400)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:81)
at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:261)
... 91 common frames omitted

2023-02-06T22:24:50.609Z ERROR 1 --- [nio-8030-exec-4] [.[.[.a.s.s.c.StreamPipesResourceConfig] : Servlet.service() for servlet [org.apache.streampipes.service.core.StreamPipesResourceConfig] in context with path [/streampipes-backend] threw exception [java.lang.NullPointerException: Cannot invoke "String.length()" because "this.input" is null] with root cause

java.lang.NullPointerException: Cannot invoke "String.length()" because "this.input" is null
at java.base/java.net.URI$Parser.parse(Unknown Source)
at java.base/java.net.URI.(Unknown Source)
at java.base/java.net.URI.create(Unknown Source)
at org.apache.http.client.fluent.Request.Get(Request.java:86)

[bossenti]

ping @dominikriemer 🙂

[dominikriemer]

I'm sorry, but I could not yet reproduce this error although I tried multiple times.
It seems something goes really wrong upon startup, but the errors seem to originate from dependencies.
Do you still get the same error? Can you give me some more hints on your configuration (OS, K8s version, setup) so that I can try to reproduce this?
Thanks!

[RuneRoven]

i a running k3OS with k3s

when trying to find elements it just keeps loading and backend throws error:

at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:261)
... 91 common frames omitted

2023-02-15T19:55:19.486Z ERROR 1 --- [nio-8030-exec-4] [.[.[.a.s.s.c.StreamPipesResourceConfig] : Servlet.service() for servlet [org.apache.streampipes.service.core.StreamPipesResourceConfig] in context with path [/streampipes-backend] threw exception [java.lang.NullPointerException: Cannot invoke "String.length()" because "this.input" is null] with root cause

java.lang.NullPointerException: Cannot invoke "String.length()" because "this.input" is null
at java.base/java.net.URI$Parser.parse(Unknown Source)
at java.base/java.net.URI.(Unknown Source)
at java.base/java.net.URI.create(Unknown Source)
at org.apache.http.client.fluent.Request.Get(Request.java:86)

and from extensions pod i get:

Caused by: org.apache.http.ProtocolException: Target host is not specified
at org.apache.http.impl.conn.DefaultRoutePlanner.determineRoute(DefaultRoutePlanner.java:71)
at org.apache.http.impl.client.InternalHttpClient.determineRoute(InternalHttpClient.java:125)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
... 22 common frames omitted

2023-02-15T19:57:39.602Z INFO 1 --- [ main] s.s.e.c.ConnectWorkerRegistrationService : Retrying in 5 seconds
2023-02-15T19:57:48.252Z ERROR 1 --- [ main] o.a.s.s.e.connect.ConnectRestClient : Could not register adapter at url - is a 'StreamPipes Core' service running?

org.apache.streampipes.commons.exceptions.SpRuntimeException: Could not connect to the StreamPipes API - please check that StreamPipes is available
at org.apache.streampipes.client.http.HttpRequest.executeRequest(HttpRequest.java:111)
at org.apache.streampipes.client.api.AbstractClientApi.post(AbstractClientApi.java:46)
at org.apache.streampipes.client.api.AdminApi.registerAdapters(AdminApi.java:36)