Forum Replies Created
-
AuthorPosts
-
Screenshot
A quick update on the issue.. All the default three beats (packetbeat, metricbeat and filebeat) were causing some issue with all my VMs. All the three services were failing to restart for different reasons. I updated all the three beats following the instructions on the elasticsearch website and it resolved the issue.
https://www.elastic.co/guide/en/beats/packetbeat/8.15/setup-repositories.html#_apt
I am not sure but maybe the installation of these beats that occurs with configuring the measurement framework in
mf = MFLib(slice_name, "/tmp/mflib")
step needs to be updated to use the latest version of the beats.I cannot see any specific log files for metricbeat in /var/log but here is the output for
journalctl -xeu metricbeat.service
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.(*ackLoop).run(0xc000bc6c30)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/ackloop.go:60 +0x118
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.NewQueue.func2(0xc000217650, 0xc000bc6c30)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:180 +0x5b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.NewQueue
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:178 +0x405
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 194 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.(*consumer).Get(0xc000baf800, 0x32, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/consume.go:65 +0xf1
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*eventConsumer).loop(0xc000e340c0, 0x55aa7a220140, 0xc000baf800)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:182 +0x1a2
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.newEventConsumer.func1(0xc000e340c0, 0x55aa7a220140, 0xc000baf7e0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:86 +0x6e
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.newEventConsumer
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:84 +0x153
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 195 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*retryer).loop(0xc000e341e0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/retry.go:135 +0x255
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.newRetryer
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/retry.go:94 +0x15d
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 196 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*netClientWorker).run(0xc000e343c0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/output.go:127 +0xcb
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.makeClientWorker
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/output.go:79 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1564 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).snapshotLoop(0xc001270570)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/monitoring/report/log/log.go:128 +0x40a
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/monitoring/report/log.MakeReporter.func1(0xc001270570)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/monitoring/report/log/log.go:106 +0x52
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/libbeat/monitoring/report/log.MakeReporter
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/monitoring/report/log/log.go:104 +0x15f
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 197 [syscall]:
Aug 30 14:33:46 Node1 metricbeat[106288]: os/signal.signal_recv(0x0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sigqueue.go:147 +0x9e
Aug 30 14:33:46 Node1 metricbeat[106288]: os/signal.loop()
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/os/signal/signal_unix.go:23 +0x25
Aug 30 14:33:46 Node1 metricbeat[106288]: created by os/signal.Notify.func1.1
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/os/signal/signal.go:150 +0x46
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 152 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001264ab0, 0xc0005c6de0, 0xc0007bdc80)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588a70, 0xc0005c6de0, 0xc0007bdc80, 0xc001264ab0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 153 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588a78)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588a70)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588a70, 0xc0007bdc80, 0xc001224410)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 154 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc0005f78e8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc0005f78e0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc0005bd830, 0xc00058ffa8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc0012244b0, 0xc0007bdc80)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 155 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001264e10, 0xc0005c6f00, 0xc0007bdd40)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588a80, 0xc0005c6f00, 0xc0007bdd40, 0xc001264e10)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 156 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588a88)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588a80)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588a80, 0xc0007bdd40, 0xc001224500)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 157 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000e2e268)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000e2e260)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc0005bdb00, 0xc0012877a8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc0012245a0, 0xc0007bdd40)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 158 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001265170, 0xc0005c7020, 0xc0007bde00)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588a90, 0xc0005c7020, 0xc0007bde00, 0xc001265170)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 159 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588a98)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588a90)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588a90, 0xc0007bde00, 0xc0012245f0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 160 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000e2e258)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000e2e250)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc0005bddd0, 0xc000bbefa8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc001224690, 0xc0007bde00)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 161 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc0012654d0, 0xc0005c7140, 0xc0007bdec0)
Aug 30 14:33:46 Node1 systemd[1]: metricbeat.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ An ExecStart= process belonging to unit metricbeat.service has exited.
░░
░░ The process’ exit code is ‘exited’ and its exit status is 2.
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588aa0, 0xc0005c7140, 0xc0007bdec0, 0xc0012654d0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1570 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588aa8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588aa0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588aa0, 0xc0007bdec0, 0xc0012246e0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1571 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000e2e2a8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000e2e2a0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc00126a120, 0xc0012827a8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc001224780, 0xc0007bdec0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1572 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001265830, 0xc0005c7260, 0xc0007fc000)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588ab0, 0xc0005c7260, 0xc0007fc000, 0xc001265830)
Aug 30 14:33:46 Node1 systemd[1]: metricbeat.service: Failed with result ‘exit-code’.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ The unit metricbeat.service has entered the ‘failed’ state with result ‘exit-code’.
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1573 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588ab8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588ab0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588ab0, 0xc0007fc000, 0xc0012247d0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1574 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000e2e2b8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000e2e2b0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc00126a3f0, 0xc001283fa8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc001224870, 0xc0007fc000)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1575 [runnable]:
Aug 30 14:33:46 Node1 metricbeat[106288]: bytes.makeSlice.func1()
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/bytes/buffer.go:224 +0x6b
Aug 30 14:33:46 Node1 metricbeat[106288]: bytes.makeSlice(0x200, 0xc001500000, 0x200, 0x200)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/bytes/buffer.go:229 +0x98
Aug 30 14:33:46 Node1 metricbeat[106288]: bytes.(*Buffer).grow(0xc000b23500, 0x200, 0xc)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/bytes/buffer.go:142 +0x156
Aug 30 14:33:46 Node1 metricbeat[106288]: bytes.(*Buffer).Grow(…)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/bytes/buffer.go:161
Aug 30 14:33:46 Node1 metricbeat[106288]: io/ioutil.readAll(0x55aa7a1f87e0, 0xc001380008, 0x200, 0x0, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/io/ioutil/ioutil.go:34 +0xa5
Aug 30 14:33:46 Node1 metricbeat[106288]: io/ioutil.ReadFile(0xc00138e110, 0xc, 0x0, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/io/ioutil/ioutil.go:73 +0xef
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/gosigar.readProcFile(0x8, 0x55aa78bf44ce, 0x4, 0x0, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/pkg/mod/github.com/elastic/gosigar@v0.14.1/sigar_linux_common.go:414 +0x154
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/gosigar.(*ProcState).Get(0xc001382060, 0x8, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/pkg/mod/github.com/elastic/gosigar@v0.14.1/sigar_linux_common.go:158 +0x5a
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/module/system/process_summary.(*MetricSet).Fetch(0xc00125c1e0, 0x7f4b183b9068, 0xc000824600, 0x7f4b183b9068, 0xc000824600)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/module/system/process_summary/process_summary.go:82 +0xff
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).fetch(0xc001265b90, 0x55aa7a268040, 0xc000826038, 0x55aa7a247c00, 0xc000824600)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:256 +0x3a7
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).startPeriodicFetching(0xc001265b90, 0x55aa7a268040, 0xc000826038, 0x55aa7a247c00, 0xc000824600)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:224 +0x8d
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001265b90, 0xc0005c7380, 0xc0007fc0c0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:208 +0x848
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588ac0, 0xc0005c7380, 0xc0007fc0c0, 0xc001265b90)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1576 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588ac8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588ac0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588ac0, 0xc0007fc0c0, 0xc0012248c0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1577 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588b68)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588b60)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc00126a6c0, 0xc0012857a8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc001224960, 0xc0007fc0c0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1578 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001265ef0, 0xc0005c74a0, 0xc0007fc180)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588ad0, 0xc0005c74a0, 0xc0007fc180, 0xc001265ef0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1579 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588ad8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588ad0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588ad0, 0xc0007fc180, 0xc0012249b0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1580 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000834018)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000834010)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc00126a990, 0xc00128efa8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc001224a50, 0xc0007fc180)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1581 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001270270, 0xc0005c75c0, 0xc0007fc240)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588ae0, 0xc0005c75c0, 0xc0007fc240, 0xc001270270)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1582 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588ae8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588ae0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588ae0, 0xc0007fc240, 0xc001224aa0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1583 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588b88)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588b80)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc00126ac60, 0xc0012807a8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc001224b40, 0xc0007fc240)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1584 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run.func1(0xc000588a60, 0xc00020c0e0, 0x55aa7a247c80, 0xc001270540)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:214 +0x65
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:212 +0x10b
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1585 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run.func2(0xc000588a60, 0xc00020c0e0, 0xc0007ec500)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:226 +0x65
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:224 +0x371
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 199 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels.func1(0xc0007bdd40)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:40 +0x158
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:48 +0xd2
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1586 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/cfgfile.(*Reloader).Run(0xc0007fc420, 0x55aa7a220480, 0xc0007ea5b0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/cfgfile/reload.go:188 +0x230
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:238 +0x4e5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1587 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run.func3(0xc000588a60, 0xc00020c0e0, 0xc0007fc420)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:242 +0x65
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:240 +0x53b
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1588 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels.func1(0xc0007fc0c0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:40 +0x158
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:48 +0xd2
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 200 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels.func1(0xc0007bdec0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:40 +0x158
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:48 +0xd2
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1589 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels.func1(0xc0007fc240)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:40 +0x158
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:48 +0xd2
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 201 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels.func1(0xc0007fc000)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:40 +0x158
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:48 +0xd2
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1566 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels.func1(0xc0007bdc80)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:40 +0x158
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:48 +0xd2
Aug 30 14:33:46 Node1 metricbeat[106288]: rax 0x0
Aug 30 14:33:46 Node1 metricbeat[106288]: rbx 0x7f4b027fc640
Aug 30 14:33:46 Node1 metricbeat[106288]: rcx 0x7f4b5a00f9fc
Aug 30 14:33:46 Node1 metricbeat[106288]: rdx 0x6
Aug 30 14:33:46 Node1 metricbeat[106288]: rdi 0x19f30
Aug 30 14:33:46 Node1 metricbeat[106288]: rsi 0x19f41
Aug 30 14:33:46 Node1 metricbeat[106288]: rbp 0x19f41
Aug 30 14:33:46 Node1 metricbeat[106288]: rsp 0x7f4b027fb7a0
Aug 30 14:33:46 Node1 metricbeat[106288]: r8 0x7f4b027fb870
Aug 30 14:33:46 Node1 metricbeat[106288]: r9 0x7fffffff
Aug 30 14:33:46 Node1 metricbeat[106288]: r10 0x8
Aug 30 14:33:46 Node1 metricbeat[106288]: r11 0x246
Aug 30 14:33:46 Node1 metricbeat[106288]: r12 0x6
Aug 30 14:33:46 Node1 metricbeat[106288]: r13 0x16
Aug 30 14:33:46 Node1 metricbeat[106288]: r14 0x55aa79109d54
Aug 30 14:33:46 Node1 metricbeat[106288]: r15 0x0
Aug 30 14:33:46 Node1 metricbeat[106288]: rip 0x7f4b5a00f9fc
Aug 30 14:33:46 Node1 metricbeat[106288]: rflags 0x246
Aug 30 14:33:46 Node1 metricbeat[106288]: cs 0x33
Aug 30 14:33:46 Node1 metricbeat[106288]: fs 0x0
Aug 30 14:33:46 Node1 metricbeat[106288]: gs 0x0
Aug 30 14:33:46 Node1 systemd[1]: metricbeat.service: Scheduled restart job, restart counter is at 4.
░░ Subject: Automatic restarting of a unit has been scheduled
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ Automatic restarting of the unit metricbeat.service has been scheduled, as the result for
░░ the configured Restart= setting for the unit.
Aug 30 14:33:46 Node1 systemd[1]: Stopped Metricbeat is a lightweight shipper for metrics..
░░ Subject: A stop job for unit metricbeat.service has finished
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ A stop job for unit metricbeat.service has finished.
░░
░░ The job identifier is 68880 and the job result is done.
Aug 30 14:33:46 Node1 systemd[1]: Started Metricbeat is a lightweight shipper for metrics..
░░ Subject: A start job for unit metricbeat.service has finished successfully
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ A start job for unit metricbeat.service has finished successfully.
░░
░░ The job identifier is 68880.
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.822Z INFO instance/beat.go:665 Home path: [/usr/share/metricbeat] Config path: [/etc/metricbeat] Data path: [/var/lib/metricbeat] Logs path: [/var/log/metricbeat]
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.822Z INFO instance/beat.go:673 Beat ID: ff5dc2c4-6d10-4f6e-a90a-3bc163f8b010
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.840Z INFO [seccomp] seccomp/seccomp.go:124 Syscall filter successfully installed
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.840Z INFO [beat] instance/beat.go:1014 Beat info {“system_info”: {“beat”: {“path”: {“config”: “/etc/metricbeat”, “data”: “/var/lib/metricbeat”, “home”: “/usr/share/metricbeat”, “logs”: “/var/log/metricbeat”}, “type”: “metricbeat”, “uuid”: “ff5dc2c4-6d10-4f6e-a90a-3bc163f8b010”}}}
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.840Z INFO [beat] instance/beat.go:1023 Build info {“system_info”: {“build”: {“commit”: “686ba416a74193f2e69dcfa2eb142f4364a79307”, “libbeat”: “7.13.2”, “time”: “2021-06-10T21:16:02.000Z”, “version”: “7.13.2”}}}
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.840Z INFO [beat] instance/beat.go:1026 Go runtime info {“system_info”: {“go”: {“os”:”linux”,”arch”:”amd64″,”max_procs”:48,”version”:”go1.15.13″}}}
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.842Z INFO [beat] instance/beat.go:1030 Host info {“system_info”: {“host”: {“architecture”:”x86_64″,”boot_time”:”2024-08-30T03:10:02Z”,”containerized”:false,”name”:”Node1″,”ip”:[“127.0.0.1/8″,”10.0.1.10/32″,”::1/128″,”10.20.5.221/23″,”fe80::f816:3eff:fe4a:8971/64″,”10.146.3.2/24″,”fe80::2d:8ff:fe2e:e28e/64″,”192.168.4.2/24″,”fe80::1018:85ff:fe14:b18f/64″,”192.168.2.2/24″,”fe80::1032:a0ff:fe2d:ec01/64″,”192.168.8.2/24″,”fe80::105b:34ff:fe9b:b3e/64″,”10.146.5.2/24″,”fe80::14ec:1dff:fe91:aa06/64″,”192.168.3.2/24″,”fe80::1802:ccff:feb9:bd5f/64″,”172.17.0.1/16″],”kernel_version”:”5.15.0-112-generic”,”mac”:[“fa:16:3e:4a:89:71″,”02:2d:08:2e:e2:8e”,”12:18:85:14:b1:8f”,”12:32:a0:2d:ec:01″,”12:5b:34:9b:0b:3e”,”16:ec:1d:91:aa:06″,”1a:02:cc:b9:bd:5f”,”02:42:5e:2d:c3:53″],”os”:{“type”:”linux”,”family”:”debian”,”platform”:”ubuntu”,”name”:”Ubuntu”,”version”:”22.04.4 LTS (Jammy Jellyfish)”,”major”:22,”minor”:4,”patch”:4,”codename”:”jammy”},”timezone”:”UTC”,”timezone_offset_sec”:0,”id”:”7761b545b6194557943b3b9f0eb83d71″}}}
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.843Z INFO [beat] instance/beat.go:1059 Process info {“system_info”: {“process”: {“capabilities”: {“inheritable”:null,”permitted”:[“chown”,”dac_override”,”dac_read_search”,”fowner”,”fsetid”,”kill”,”setgid”,”setuid”,”setpcap”,”linux_immutable”,”net_bind_service”,”net_broadcast”,”net_admin”,”net_raw”,”ipc_lock”,”ipc_owner”,”sys_module”,”sys_rawio”,”sys_chroot”,”sys_ptrace”,”sys_pacct”,”sys_admin”,”sys_boot”,”sys_nice”,”sys_resource”,”sys_time”,”sys_tty_config”,”mknod”,”lease”,”audit_write”,”audit_control”,”setfcap”,”mac_override”,”mac_admin”,”syslog”,”wake_alarm”,”block_suspend”,”audit_read”,”38″,”39″,”40″],”effective”:[“chown”,”dac_override”,”dac_read_search”,”fowner”,”fsetid”,”kill”,”setgid”,”setuid”,”setpcap”,”linux_immutable”,”net_bind_service”,”net_broadcast”,”net_admin”,”net_raw”,”ipc_lock”,”ipc_owner”,”sys_module”,”sys_rawio”,”sys_chroot”,”sys_ptrace”,”sys_pacct”,”sys_admin”,”sys_boot”,”sys_nice”,”sys_resource”,”sys_time”,”sys_tty_config”,”mknod”,”lease”,”audit_write”,”audit_control”,”setfcap”,”mac_override”,”mac_admin”,”syslog”,”wake_alarm”,”block_suspend”,”audit_read”,”38″,”39″,”40″],”bounding”:[“chown”,”dac_override”,”dac_read_search”,”fowner”,”fsetid”,”kill”,”setgid”,”setuid”,”setpcap”,”linux_immutable”,”net_bind_service”,”net_broadcast”,”net_admin”,”net_raw”,”ipc_lock”,”ipc_owner”,”sys_module”,”sys_rawio”,”sys_chroot”,”sys_ptrace”,”sys_pacct”,”sys_admin”,”sys_boot”,”sys_nice”,”sys_resource”,”sys_time”,”sys_tty_config”,”mknod”,”lease”,”audit_write”,”audit_control”,”setfcap”,”mac_override”,”mac_admin”,”syslog”,”wake_alarm”,”block_suspend”,”audit_read”,”38″,”39″,”40″],”ambient”:null}, “cwd”: “/”, “exe”: “/usr/share/metricbeat/bin/metricbeat”, “name”: “metricbeat”, “pid”: 106331, “ppid”: 1, “seccomp”: {“mode”:”filter”,”no_new_privs”:true}, “start_time”: “2024-08-30T14:33:46.140Z”}}}
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.843Z INFO instance/beat.go:309 Setup Beat: metricbeat; Version: 7.13.2
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.843Z INFO [index-management] idxmgmt/std.go:184 Set output.elasticsearch.index to ‘metricbeat-7.13.2’ as ILM is enabled.
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.843Z INFO eslegclient/connection.go:99 elasticsearch url: http://10.136.130.2:9200
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.843Z INFO [publisher] pipeline/module.go:113 Beat name: Node1
Aug 30 14:33:46 Node1 metricbeat[106331]: runtime/cgo: pthread_create failed: Operation not permitted
Aug 30 14:33:46 Node1 metricbeat[106331]: SIGABRT: abort
Aug 30 14:33:46 Node1 metricbeat[106331]: PC=0x7f505ed6c9fc m=16 sigcode=18446744073709551610
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 0 [idle]:
Aug 30 14:33:46 Node1 metricbeat[106331]: runtime: unknown pc 0x7f505ed6c9fc
Aug 30 14:33:46 Node1 metricbeat[106331]: stack: frame={sp:0x7f4ff3ffe7a0, fp:0x0} stack=[0x7f4ff37ff1e8,0x7f4ff3ffede8)
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6a0: 0000000001a37897 0000563c6073639c
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6b0: 0000000000000000 0000563c5daa3c1e <runtime.callCgoMmap+62>
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6c0: 00007f4ff3ffe6c8 00007f4ff3ffe758
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6d0: 0000563c5da5059b <runtime.scanframeworker+155> 00007f4ff3ffe718
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6e0: 0000563c5da94f1a <runtime.mmap.func1+90> 0000000000000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6f0: 0000000000040000 0000002200000003
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe700: 00000000ffffffff 00007f50340fb000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe710: 00007f4ff3ffe758 00007f4ff3ffe790
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe720: 0000563c5da3349e <runtime.mmap+158> 00007f4ff3ffe760
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe730: 0000000000000000 0000000000000130
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe740: 0000000000000000 0000563c00000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe750: 000000135daa1e80 0000000000000120
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe760: 0000563c5da94ec0 <runtime.mmap.func1+0> 0000000000000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe770: 0000000000040000 0000002200000003
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe780: 0000000000000004 0000003400000013
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe790: 0000000000000000 00007f505ed6c9ee
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7a0: <0000000000000000 000000770000007c
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7b0: 0000005b0000006e 00000000ffffffff
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7c0: 00007f50340fb000 00007f505edfc8a1
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7d0: 00007f4ff17fa640 00007f4ff3ffeab0
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7e0: 00007f4ff3ffe92e 00007f4ff3ffe92f
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7f0: 0000000000000000 00007f505ed6a6d9
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe800: 00000000007fff00 0000000000000008
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe810: 00000000003d0f00 00007f4ff17fa910
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe820: 00007f4ff17fa910 e9bba71dae960200
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe830: 00007f4ff3fff640 0000000000000006
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe840: 00000000000000f1 0000000000000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe850: 0000563c60d09d54 00007f505ed18476
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe860: 00007f505eef1e90 00007f505ecfe7f3
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe870: 0000000000000020 00007f4ff17fa640
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe880: 0000000000000000 0000000000000001
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe890: 00007f4ff17fa640 00007f505ed6b544
Aug 30 14:33:46 Node1 metricbeat[106331]: runtime: unknown pc 0x7f505ed6c9fc
Aug 30 14:33:46 Node1 metricbeat[106331]: stack: frame={sp:0x7f4ff3ffe7a0, fp:0x0} stack=[0x7f4ff37ff1e8,0x7f4ff3ffede8)
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6a0: 0000000001a37897 0000563c6073639c
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6b0: 0000000000000000 0000563c5daa3c1e <runtime.callCgoMmap+62>
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6c0: 00007f4ff3ffe6c8 00007f4ff3ffe758
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6d0: 0000563c5da5059b <runtime.scanframeworker+155> 00007f4ff3ffe718
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6e0: 0000563c5da94f1a <runtime.mmap.func1+90> 0000000000000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6f0: 0000000000040000 0000002200000003
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe700: 00000000ffffffff 00007f50340fb000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe710: 00007f4ff3ffe758 00007f4ff3ffe790
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe720: 0000563c5da3349e <runtime.mmap+158> 00007f4ff3ffe760
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe730: 0000000000000000 0000000000000130
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe740: 0000000000000000 0000563c00000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe750: 000000135daa1e80 0000000000000120
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe760: 0000563c5da94ec0 <runtime.mmap.func1+0> 0000000000000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe770: 0000000000040000 0000002200000003
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe780: 0000000000000004 0000003400000013
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe790: 0000000000000000 00007f505ed6c9ee
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7a0: <0000000000000000 000000770000007c
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7b0: 0000005b0000006e 00000000ffffffff
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7c0: 00007f50340fb000 00007f505edfc8a1
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7d0: 00007f4ff17fa640 00007f4ff3ffeab0
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7e0: 00007f4ff3ffe92e 00007f4ff3ffe92f
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7f0: 0000000000000000 00007f505ed6a6d9
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe800: 00000000007fff00 0000000000000008
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe810: 00000000003d0f00 00007f4ff17fa910
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe820: 00007f4ff17fa910 e9bba71dae960200
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe830: 00007f4ff3fff640 0000000000000006
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe840: 00000000000000f1 0000000000000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe850: 0000563c60d09d54 00007f505ed18476
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe860: 00007f505eef1e90 00007f505ecfe7f3
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe870: 0000000000000020 00007f4ff17fa640
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe880: 0000000000000000 0000000000000001
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe890: 00007f4ff17fa640 00007f505ed6b544
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 1 [runnable]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.parseVarExp(0xc0003440c0, 0x563c607f244d, 0x1, 0xc000344120, 0xc000868000, 0x120, 0x110)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/variables.go:451 +0xd79
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.parseSplice(0xc0005c6280, 0x1d, 0x563c607f244d, 0x1, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/variables.go:347 +0xd8
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeString(0x0, 0x0, 0x0, 0x0, 0xc00059e3f0, 0xc0005c6280, 0x1d, 0x7f505ec959b8, 0xc00084c0d0, 0x563c5da32e7c, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:518 +0x76
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeValue(0xc00059e3f0, 0xc000000000, 0x0, 0x0, 0x0, 0x0, 0x563c6148af60, 0xc00084c0e0, 0x94, 0x563c5db10b0a, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:489 +0xd53
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeSetField(0xc000592de0, 0xc00059e3f0, 0x0, 0xc0005fc078, 0x4, 0x563c6148af60, 0xc00084c0e0, 0x94, 0x94, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:377 +0x9a
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeMapInto(0xc000592de0, 0xc00059e3f0, 0x563c6152be00, 0xc000592cc0, 0x15, 0x563c6130d0c0, 0x563c6152be00)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:313 +0x238
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeMap(0xc00059e3f0, 0x563c6152be00, 0xc000592cc0, 0x15, 0xc000592cc0, 0x15, 0x14)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:295 +0xaa
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeMapValue(0xc00059e3f0, 0x563c61eadd40, 0xc000592db0, 0x563c63c57cc0, 0x1, 0x563c6152be00, 0xc000592cc0, 0x15, 0x1, 0x563c5daad985, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:416 +0x52
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeValue(0xc00059e3f0, 0xc000000000, 0x563c61eadd40, 0xc000592db0, 0x563c63c57cc0, 0x1, 0x563c6148af60, 0xc000590710, 0x194, 0x563c5da4515b, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:493 +0xa2f
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeArray(0xc00059e3f0, 0x563c61000000, 0x0, 0x0, 0x0, 0x0, 0x563c6130d0c0, 0xc0005f4300, 0x97, 0x563c5da32e7c, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:445 +0x2e5
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeValue(0xc00059e3f0, 0xc000000000, 0x0, 0x0, 0x0, 0x0, 0x563c6148af60, 0xc0005907f0, 0x94, 0x563c5db10b0a, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:491 +0x97c
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeSetField(0xc000592d80, 0xc00059e3f0, 0x0, 0xc0005fc050, 0xa, 0x563c6148af60, 0xc0005907f0, 0x94, 0x94, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:377 +0x9a
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeMapInto(0xc000592d80, 0xc00059e3f0, 0x563c6152be00, 0xc000592c90, 0x15, 0xc000c60378, 0xc000592c90)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:313 +0x238
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeMap(0xc00059e3f0, 0x563c6152be00, 0xc000592c90, 0x15, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:295 +0xaa
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalize(0xc00059e3f0, 0x563c6152be00, 0xc000592c90, 0xc00059e3f0, 0x563c61737320, 0x563c60d0807e)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:277 +0x2fc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.(*Config).Merge(0xc000592cf0, 0x563c6152be00, 0xc000592c90, 0xc000592ba0, 0x5, 0x6, 0x563c61d4a758, 0xc000c60458)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:79 +0x7a
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.NewFrom(0x563c6152be00, 0xc000592c90, 0xc000592ba0, 0x5, 0x6, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/ucfg.go:105 +0xa5
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg/yaml.NewConfig(0xc001592000, 0x5a, 0x25a, 0xc000592ba0, 0x5, 0x6, 0x1, 0x6, 0xc000c604f8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/yaml/yaml.go:35 +0xe6
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg/yaml.NewConfigWithFile(0xc00158e000, 0x2c, 0xc000631920, 0x4, 0x6, 0xc000c60570, 0x563c5dae662f, 0xc00158e000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/yaml/yaml.go:48 +0x168
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common.LoadFile(0xc00158e000, 0x2c, 0x563c61e86340, 0xc001590000, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/config.go:152 +0x87
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/mb.(*LightModulesSource).loadModuleConfig(0xc000897920, 0xc00158e000, 0x2c, 0xc00158e000, 0x2c, 0xc0004da001)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/mb/lightmodules.go:211 +0x4f
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/mb.(*LightModulesSource).loadModule(0xc000897920, 0xc00032c040, 0xc0008d9a5d, 0x4, 0xc0012c9a40, 0xb, 0x73)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/mb/lightmodules.go:187 +0x96
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/mb.(*LightModulesSource).MetricSets(0xc000897920, 0xc00032c040, 0xc0008d9a5d, 0x4, 0x2, 0xc0005c6120, 0x11, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/mb/lightmodules.go:90 +0x6c
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/mb.(*LightModulesSource).ModulesInfo(0xc000897920, 0xc00032c040, 0xc00139eb30, 0x2)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/mb/lightmodules.go:145 +0x189
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/mb.(*Register).String(0xc00032c040, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/mb/registry.go:433 +0x7cc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/beater.newMetricbeat(0xc000660e00, 0xc000715d10, 0xc000938470, 0x2, 0x2, 0x563c5f16f753, 0xc0005a82a0, 0x563c61d4bcb8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:151 +0x1e5
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/beater.Creator.func1(0xc000660e00, 0xc000715d10, 0x6, 0x563c61dfa6e0, 0xc0008978a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:81 +0x52
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).createBeater(0xc000660e00, 0xc0007810e0, 0x0, 0x24, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:377 +0x799
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).launch(0xc000660e00, 0x563c608032b5, 0xa, 0x563c608032b5, 0xa, 0x0, 0x0, 0x101, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:440 +0x4b9
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/cmd/instance.Run.func1(0x563c608032b5, 0xa, 0x563c608032b5, 0xa, 0x0, 0x0, 0x101, 0xc00139fc20, 0xc0007810e0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:196 +0x5a8
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/cmd/instance.Run(0x563c608032b5, 0xa, 0x563c608032b5, 0xa, 0x0, 0x0, 0x101, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:197 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/cmd.genRunCmd.func1(0xc000155340, 0xc000157080, 0x0, 0xc)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/cmd/run.go:36 +0x85
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/spf13/cobra.(*Command).execute(0xc000155340, 0xc0000501b0, 0xc, 0xc, 0xc000155340, 0xc0000501b0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:830 +0x2c2
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/spf13/cobra.(*Command).ExecuteC(0xc000155340, 0x0, 0xffffffff, 0xc000112058)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:914 +0x30b
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/spf13/cobra.(*Command).Execute(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:864
Aug 30 14:33:46 Node1 metricbeat[106331]: main.main()
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/x-pack/metricbeat/main.go:21 +0x31
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 41 [IO wait]:
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d59f0, 0x77, 0xc0002de180)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc000f14098, 0x77, 0x563c61e67900, 0xc0003ec300, 0xc000f14080)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitWrite(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:96
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).WaitWrite(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:508
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).connect(0xc000f14080, 0x563c61e67980, 0xc0003ec300, 0x0, 0x0, 0x563c61df8a00, 0xc0007ec020, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_unix.go:141 +0x26d
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).dial(0xc000f14080, 0x563c61e67980, 0xc0003ec300, 0x563c61e86220, 0x0, 0x563c61e86220, 0xc0007e0180, 0x0, 0x6564202020202001, 0xc000c19408)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/sock_posix.go:149 +0x108
Aug 30 14:33:46 Node1 metricbeat[106331]: net.socket(0x563c61e67980, 0xc0003ec300, 0x563c607f322f, 0x3, 0x2, 0x1, 0x0, 0x0, 0x563c61e86220, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/sock_posix.go:70 +0x1c5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.internetSocket(0x563c61e67980, 0xc0003ec300, 0x563c607f322f, 0x3, 0x563c61e86220, 0x0, 0x563c61e86220, 0xc0007e0180, 0x1, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/ipsock_posix.go:141 +0x145
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*sysDialer).doDialTCP(0xc000f14000, 0x563c61e67980, 0xc0003ec300, 0x0, 0xc0007e0180, 0x563c615672c0, 0x563c63e41638, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/tcpsock_posix.go:65 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*sysDialer).dialTCP(0xc000f14000, 0x563c61e67980, 0xc0003ec300, 0x0, 0xc0007e0180, 0x563c5dbadd00, 0x563c607f322f, 0x7f503577d008)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/tcpsock_posix.go:61 +0xd9
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*sysDialer).dialSingle(0xc000f14000, 0x563c61e67980, 0xc0003ec300, 0x563c61e27940, 0xc0007e0180, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/dial.go:580 +0x5e5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*sysDialer).dialSerial(0xc000f14000, 0x563c61e67980, 0xc0003ec300, 0xc000f0e040, 0x1, 0x1, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/dial.go:548 +0x154
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*Dialer).DialContext(0xc0003ec1e0, 0x563c61e67980, 0xc0003ec300, 0x563c607f322f, 0x3, 0xc0007ec000, 0x13, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/dial.go:425 +0x6f7
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).dial(0xc000588000, 0x563c61e67980, 0xc0003ec300, 0x563c607f322f, 0x3, 0xc0007ec000, 0x13, 0x0, 0x7974202020202020, 0x74786574203a6570, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1144 +0x1fd
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).dialConn(0xc000588000, 0x563c61e67980, 0xc0003ec300, 0x0, 0xc0008899c0, 0x5, 0xc0007ec000, 0x13, 0x0, 0xc000f12000, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1582 +0x1adb
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).dialConnFor(0xc000588000, 0xc0007ee000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1424 +0xc8
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).queueForDial
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1393 +0x40f
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 42 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).connect.func2(0x563c61e67980, 0xc0003ec300, 0xc000f14080, 0xc0001124e0, 0xc000112480)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_unix.go:118 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net.(*netFD).connect
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_unix.go:117 +0x245
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 86 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106331]: k8s.io/klog/v2.(*loggingT).flushDaemon(0x563c63e0b6e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/k8s.io/klog/v2@v2.2.0/klog.go:1131 +0x8d
Aug 30 14:33:46 Node1 metricbeat[106331]: created by k8s.io/klog/v2.init.0
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/k8s.io/klog/v2@v2.2.0/klog.go:416 +0xd8
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 87 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor.func1(0xc0005bb7c0, 0xc0005bb680)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:245 +0xbd
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:243 +0x94
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 88 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor.func1(0xc0005bb810, 0xc0005bb6d0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:245 +0xbd
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:243 +0x94
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 89 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor.func1(0xc0005bb860, 0xc0005bb720)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:245 +0xbd
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:243 +0x94
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 90 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor.func1(0xc0005bb8b0, 0xc0005bb770)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:245 +0xbd
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:243 +0x94
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 58 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: go.opencensus.io/stats/view.(*worker).start(0xc000917d60)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/go.opencensus.io@v0.22.2/stats/view/worker.go:154 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: created by go.opencensus.io/stats/view.init.0
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/go.opencensus.io@v0.22.2/stats/view/worker.go:32 +0x59
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 114 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata(0xc000a1ba10, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:163 +0x4cc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).init.func1()
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/add_cloud_metadata.go:99 +0x45
Aug 30 14:33:46 Node1 metricbeat[106331]: sync.(*Once).doSlow(0xc000a1ba10, 0xc00024b7b8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/sync/once.go:66 +0xee
Aug 30 14:33:46 Node1 metricbeat[106331]: sync.(*Once).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/sync/once.go:57
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).init(0xc000a1ba10)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/add_cloud_metadata.go:98 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.New
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/add_cloud_metadata.go:88 +0x2c6
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 130 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).getConn(0xc000588000, 0xc0007ea000, 0x0, 0xc0008899c0, 0x5, 0xc0007ec000, 0x13, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1350 +0x5ac
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).roundTrip(0xc000588000, 0xc0007e8200, 0x563c61cc2a40, 0x301, 0xc0007e8200)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:569 +0x7ce
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).RoundTrip(0xc000588000, 0xc0007e8200, 0xc000588000, 0xc1ac93f371357b57, 0xb919b804)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/roundtrip.go:17 +0x37
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.send(0xc0007e8100, 0x563c61df84c0, 0xc000588000, 0xc1ac93f371357b57, 0xb919b804, 0x563c63e0aee0, 0xc0006d0a98, 0xc1ac93f371357b57, 0x1, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:252 +0x453
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).send(0xc0007e0060, 0xc0007e8100, 0xc1ac93f371357b57, 0xb919b804, 0x563c63e0aee0, 0xc0006d0a98, 0x0, 0x1, 0xf8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:176 +0xff
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).do(0xc0007e0060, 0xc0007e8100, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:718 +0x45f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:586
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchRaw(0xc000a1b3e0, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0xc0008899c0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:101 +0x375
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchMetadata(0xc000a1b3e0, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:70 +0x1dc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata.func2(0x563c61e67980, 0xc0003ec300, 0xc000540060, 0x563c61df2be0, 0xc000a1b3e0, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:157 +0xb0
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:154 +0x3bc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 131 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).roundTrip(0xc000f88000, 0xc000e28000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2573 +0x7a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).roundTrip(0xc000588000, 0xc000e24200, 0x563c61cc2a40, 0x1, 0xc000e24200)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:582 +0xab8
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).RoundTrip(0xc000588000, 0xc000e24200, 0xc000588000, 0xc1ac93f37135fca5, 0xb91a3949)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/roundtrip.go:17 +0x37
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.send(0xc000e24100, 0x563c61df84c0, 0xc000588000, 0xc1ac93f37135fca5, 0xb91a3949, 0x563c63e0aee0, 0xc000e26008, 0xc1ac93f37135fca5, 0x1, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:252 +0x453
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).send(0xc0006fc060, 0xc000e24100, 0xc1ac93f37135fca5, 0xb91a3949, 0x563c63e0aee0, 0xc000e26008, 0x0, 0x1, 0xf8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:176 +0xff
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).do(0xc0006fc060, 0xc000e24100, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:718 +0x45f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:586
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchRaw(0xc000a1b500, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0xc0001ff590, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:101 +0x375
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchMetadata(0xc000a1b500, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:70 +0x1dc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata.func2(0x563c61e67980, 0xc0003ec300, 0xc000540060, 0x563c61df2be0, 0xc000a1b500, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:157 +0xb0
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:154 +0x3bc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 132 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).roundTrip(0xc000c28000, 0xc000c1e000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2573 +0x7a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).roundTrip(0xc000588000, 0xc000c12200, 0x563c61cc2a40, 0x301, 0xc000c12200)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:582 +0xab8
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).RoundTrip(0xc000588000, 0xc000c12200, 0xc000588000, 0xc1ac93f37134a133, 0xb918ddae)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/roundtrip.go:17 +0x37
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.send(0xc000c12100, 0x563c61df84c0, 0xc000588000, 0xc1ac93f37134a133, 0xb918ddae, 0x563c63e0aee0, 0xc000012250, 0xc1ac93f37134a133, 0x1, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:252 +0x453
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).send(0xc000826060, 0xc000c12100, 0xc1ac93f37134a133, 0xb918ddae, 0x563c63e0aee0, 0xc000012250, 0x0, 0x1, 0x7f50341be638)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:176 +0xff
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).do(0xc000826060, 0xc000c12100, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:718 +0x45f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:586
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchRaw(0xc000a1b650, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0xc000056550, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:101 +0x375
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchMetadata(0xc000a1b650, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:70 +0x1dc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata.func2(0x563c61e67980, 0xc0003ec300, 0xc000540060, 0x563c61df2be0, 0xc000a1b650, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:157 +0xb0
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:154 +0x3bc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 133 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).roundTrip(0xc000a38000, 0xc000a2c000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2573 +0x7a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).roundTrip(0xc000588000, 0xc000a28200, 0x563c61cc2a40, 0x1, 0xc000a28200)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:582 +0xab8
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).RoundTrip(0xc000588000, 0xc000a28200, 0xc000588000, 0xc1ac93f3713827df, 0xb91c6496)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/roundtrip.go:17 +0x37
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.send(0xc000a28100, 0x563c61df84c0, 0xc000588000, 0xc1ac93f3713827df, 0xb91c6496, 0x563c63e0aee0, 0xc000a2a008, 0xc1ac93f3713827df, 0x1, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:252 +0x453
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).send(0xc000a24060, 0xc000a28100, 0xc1ac93f3713827df, 0xb91c6496, 0x563c63e0aee0, 0xc000a2a008, 0x0, 0x1, 0xf8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:176 +0xff
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).do(0xc000a24060, 0xc000a28100, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:718 +0x45f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:586
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchRaw(0xc000a1b770, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0xc000889a80, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:101 +0x375
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchMetadata(0xc000a1b770, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:70 +0x1dc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata.func2(0x563c61e67980, 0xc0003ec300, 0xc000540060, 0x563c61df2be0, 0xc000a1b770, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:157 +0xb0
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:154 +0x3bc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 134 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).roundTrip(0xc00142e000, 0xc001420000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2573 +0x7a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).roundTrip(0xc000588000, 0xc001414200, 0x563c61cc2a40, 0x1, 0xc001414200)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:582 +0xab8
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).RoundTrip(0xc000588000, 0xc001414200, 0xc000588000, 0xc1ac93f371387f1b, 0xb91cbbb4)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/roundtrip.go:17 +0x37
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.send(0xc001414100, 0x563c61df84c0, 0xc000588000, 0xc1ac93f371387f1b, 0xb91cbbb4, 0x563c63e0aee0, 0xc001416008, 0xc1ac93f371387f1b, 0x1, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:252 +0x453
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).send(0xc001410060, 0xc001414100, 0xc1ac93f371387f1b, 0xb91cbbb4, 0x563c63e0aee0, 0xc001416008, 0x0, 0x1, 0xf8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:176 +0xff
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).do(0xc001410060, 0xc001414100, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:718 +0x45f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:586
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchRaw(0xc000a1b890, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0xc0000565f0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:101 +0x375
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchMetadata(0xc000a1b890, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:70 +0x1dc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata.func2(0x563c61e67980, 0xc0003ec300, 0xc000540060, 0x563c61df2be0, 0xc000a1b890, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:157 +0xb0
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:154 +0x3bc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 135 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).roundTrip(0xc0005f6000, 0xc0005b8300, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2573 +0x7a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).roundTrip(0xc000588000, 0xc0005a0200, 0x563c61cc2a40, 0x7f503443b701, 0xc0005a0200)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:582 +0xab8
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).RoundTrip(0xc000588000, 0xc0005a0200, 0xc000588000, 0xc1ac93f371340f75, 0xb9184c04)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/roundtrip.go:17 +0x37
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.send(0xc0005a0100, 0x563c61df84c0, 0xc000588000, 0xc1ac93f371340f75, 0xb9184c04, 0x563c63e0aee0, 0xc00062c030, 0xc1ac93f371340f75, 0x1, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:252 +0x453
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).send(0xc000592060, 0xc0005a0100, 0xc1ac93f371340f75, 0xb9184c04, 0x563c63e0aee0, 0xc00062c030, 0x0, 0x1, 0x7f503443b778)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:176 +0xff
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).do(0xc000592060, 0xc0005a0100, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:718 +0x45f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:586
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchRaw(0xc000a1b9e0, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0xc000056640, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:101 +0x375
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchMetadata(0xc000a1b9e0, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:70 +0x1dc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata.func2(0x563c61e67980, 0xc0003ec300, 0xc000540060, 0x563c61df2be0, 0xc000a1b9e0, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:157 +0xb0
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:154 +0x3bc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 116 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).readLoop(0xc0007dad80)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2167 +0x9ac
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1715 +0xcb7
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 117 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).writeLoop(0xc0007dad80)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2346 +0x11e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1716 +0xcdc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 178 [IO wait]:
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d5908, 0x72, 0x563c61dfc5e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc000f8a098, 0x72, 0x563c61dfc500, 0x563c63c023a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitRead(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).Read(0xc000f8a080, 0xc00083e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).Read(0xc000f8a080, 0xc00083e000, 0x1000, 0x1000, 0x90, 0x563c61b07840, 0x400)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_posix.go:55 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*conn).Read(0xc00083c000, 0xc00083e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/net.go:182 +0x90
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).Read(0xc000f88000, 0xc00083e000, 0x1000, 0x1000, 0x563c5da35690, 0x60, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1894 +0x77
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).fill(0xc000344000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:101 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).Peek(0xc000344000, 0x1, 0xc000540360, 0x0, 0x563c63e42dc0, 0xc000247530, 0x563c5da3d990)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:139 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).readLoop(0xc000f88000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2047 +0x1aa
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1715 +0xcb7
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 94 [IO wait]:
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d5820, 0x72, 0x563c61dfc5e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc000172098, 0x72, 0x563c61dfc500, 0x563c63c023a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitRead(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).Read(0xc000172080, 0xc000c2c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).Read(0xc000172080, 0xc000c2c000, 0x1000, 0x1000, 0x90, 0x563c61b07840, 0x400)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_posix.go:55 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*conn).Read(0xc000012560, 0xc000c2c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/net.go:182 +0x90
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).Read(0xc0005f6000, 0xc000c2c000, 0x1000, 0x1000, 0x563c5da35690, 0x60, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1894 +0x77
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).fill(0xc0006d87e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:101 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).Peek(0xc0006d87e0, 0x1, 0xc000c222a0, 0x0, 0x563c63e42dc0, 0xc000249530, 0x563c5da3d990)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:139 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).readLoop(0xc0005f6000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2047 +0x1aa
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1715 +0xcb7
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 32 [IO wait]:
Aug 30 14:33:46 Node1 systemd[1]: metricbeat.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ An ExecStart= process belonging to unit metricbeat.service has exited.
░░
░░ The process’ exit code is ‘exited’ and its exit status is 2.
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d5738, 0x72, 0x563c61dfc5e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc000c2a098, 0x72, 0x563c61dfc500, 0x563c63c023a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitRead(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).Read(0xc000c2a080, 0xc000a40000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).Read(0xc000c2a080, 0xc000a40000, 0x1000, 0x1000, 0x90, 0x563c61b07840, 0x400)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_posix.go:55 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*conn).Read(0xc000a2a010, 0xc000a40000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/net.go:182 +0x90
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).Read(0xc000c28000, 0xc000a40000, 0x1000, 0x1000, 0x563c5da35690, 0x60, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1894 +0x77
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).fill(0xc000315440)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:101 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).Peek(0xc000315440, 0x1, 0xc000a302a0, 0x2, 0x563c63e42dc0, 0xc000247d30, 0x563c5da3d990)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:139 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).readLoop(0xc000c28000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2047 +0x1aa
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1715 +0xcb7
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 164 [IO wait]:
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d5650, 0x72, 0x563c61dfc5e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc000a3c098, 0x72, 0x563c61dfc500, 0x563c63c023a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitRead(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).Read(0xc000a3c080, 0xc001434000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).Read(0xc000a3c080, 0xc001434000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_posix.go:55 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*conn).Read(0xc001416018, 0xc001434000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 systemd[1]: metricbeat.service: Failed with result ‘exit-code’.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ The unit metricbeat.service has entered the ‘failed’ state with result ‘exit-code’.
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/net.go:182 +0x90
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).Read(0xc000a38000, 0xc001434000, 0x1000, 0x1000, 0x563c5da35690, 0x60, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1894 +0x77
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).fill(0xc000316480)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:101 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).Peek(0xc000316480, 0x1, 0xc0005403c0, 0x0, 0x0, 0xc000606530, 0x563c5da3d990)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:139 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).readLoop(0xc000a38000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2047 +0x1aa
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1715 +0xcb7
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 33 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).writeLoop(0xc000c28000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2346 +0x11e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1716 +0xcdc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 179 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).writeLoop(0xc000f88000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2346 +0x11e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1716 +0xcdc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 95 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).writeLoop(0xc0005f6000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2346 +0x11e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1716 +0xcdc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 148 [IO wait]:
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d5568, 0x72, 0x563c61dfc5e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc001432098, 0x72, 0x563c61dfc500, 0x563c63c023a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitRead(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).Read(0xc001432080, 0xc000f8c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).Read(0xc001432080, 0xc000f8c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_posix.go:55 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*conn).Read(0xc000e26018, 0xc000f8c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/net.go:182 +0x90
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).Read(0xc00142e000, 0xc000f8c000, 0x1000, 0x1000, 0x563c5da35690, 0x60, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1894 +0x77
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).fill(0xc0000feb40)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:101 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).Peek(0xc0000feb40, 0x1, 0xc000540420, 0x0, 0x563c63e42dc0, 0xc000248d30, 0x563c5da3d990)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:139 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).readLoop(0xc00142e000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2047 +0x1aa
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1715 +0xcb7
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 165 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).writeLoop(0xc000a38000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2346 +0x11e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1716 +0xcdc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 149 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).writeLoop(0xc00142e000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2346 +0x11e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1716 +0xcdc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 166 [IO wait]:
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d5ad8, 0x72, 0x563c61dfc5e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc0005e8e18, 0x72, 0x563c61dfc500, 0x563c63c023a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitRead(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).Read(0xc0005e8e00, 0xc000bb7000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).Read(0xc0005e8e00, 0xc000bb7000, 0x1000, 0x1000, 0xc001414600, 0x28, 0xc00059e1b0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_posix.go:55 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*conn).Read(0xc00053cb90, 0xc000bb7000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/net.go:182 +0x90
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).Read(0xc0007dad80, 0xc000bb7000, 0x1000, 0x1000, 0x563c5dd6105f, 0xc001414600, 0x563c61df84c0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1894 +0x77
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).fill(0xc000903260)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:101 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).ReadSlice(0xc000903260, 0x10a, 0x7f5038361fff, 0x400, 0x7f5038191e00, 0x20300000000000, 0x7f5038361fff)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:360 +0x3f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http/internal.readChunkLine(0xc000903260, 0x7f5038361fff, 0xc000f09a78, 0x563c5da48ebf, 0x7f5038191d00, 0x20300000000000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/internal/chunked.go:122 +0x36
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http/internal.(*chunkedReader).beginChunk(0xc000592210)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/internal/chunked.go:48 +0x34
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http/internal.(*chunkedReader).Read(0xc000592210, 0xc0005fa000, 0x200, 0x200, 0x7f5034392938, 0xc000f09b48, 0x563c5da3d48a)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/internal/chunked.go:93 +0x145
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*body).readLocked(0xc0005b8380, 0xc0005fa000, 0x200, 0x200, 0xc0005fa000, 0x7f5034392938, 0xc000f09b01)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transfer.go:833 +0x62
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*body).Read(0xc0005b8380, 0xc0005fa000, 0x200, 0x200, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transfer.go:825 +0xf9
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*bodyEOFSignal).Read(0xc0005b8600, 0xc0005fa000, 0x200, 0x200, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2727 +0xe2
Aug 30 14:33:46 Node1 metricbeat[106331]: encoding/json.(*Decoder).refill(0xc0004c6580, 0x88, 0x7f505eca7808)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/encoding/json/stream.go:165 +0xed
Aug 30 14:33:46 Node1 metricbeat[106331]: encoding/json.(*Decoder).readValue(0xc0004c6580, 0x0, 0x0, 0x563c61ad01a0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/encoding/json/stream.go:140 +0x1ff
Aug 30 14:33:46 Node1 metricbeat[106331]: encoding/json.(*Decoder).Decode(0xc0004c6580, 0x563c61253080, 0xc00059e240, 0x563c61df84e0, 0xc0005b8600)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/encoding/json/stream.go:63 +0x7b
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/docker/docker/client.(*Client).Events.func1(0xc000316de0, 0xc0005e8d00, 0xc001422f40, 0x1e, 0x0, 0x0, 0xc0014116b0, 0xc0014244e0, 0x563c61e67900, 0xc001420580, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/docker/engine@v0.0.0-20191113042239-ea84732a7725/client/events.go:53 +0x365
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/docker/docker/client.(*Client).Events
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/docker/engine@v0.0.0-20191113042239-ea84732a7725/client/events.go:25 +0x119
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 195 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common/docker.(*watcher).watch.func1(0x563c63e41600)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/docker/watcher.go:276 +0x445
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common/docker.(*watcher).watch(0xc0014440a0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/docker/watcher.go:319 +0x214
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/common/docker.(*watcher).Start
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/docker/watcher.go:238 +0x305
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 196 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common/docker.(*watcher).cleanupWorker(0xc0014440a0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/docker/watcher.go:426 +0x125
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/common/docker.(*watcher).Start
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/docker/watcher.go:239 +0x32a
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 200 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_kubernetes_metadata.(*cache).cleanup(0xc00089ab70)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_kubernetes_metadata/cache.go:79 +0x235
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_kubernetes_metadata.newCache
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_kubernetes_metadata/cache.go:44 +0xc6
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 204 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.(*bufferingEventLoop).run(0xc0008b3220)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/eventloop.go:316 +0x1d1
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.NewQueue.func1(0xc0005822a0, 0x563c61e20100, 0xc0008b3220)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:176 +0x62
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.NewQueue
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:174 +0x3ce
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 205 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.(*ackLoop).run(0xc0008ccbe0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/ackloop.go:60 +0x118
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.NewQueue.func2(0xc0005822a0, 0xc0008ccbe0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:180 +0x5b
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.NewQueue
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:178 +0x405
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 206 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.(*consumer).Get(0xc000897880, 0x32, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/consume.go:65 +0xf1
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*eventConsumer).loop(0xc00037e5a0, 0x563c61e20140, 0xc000897880)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:182 +0x1a2
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.newEventConsumer.func1(0xc00037e5a0, 0x563c61e20140, 0xc000897860)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:86 +0x6e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.newEventConsumer
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:84 +0x153
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 207 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*retryer).loop(0xc00037e780)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/retry.go:135 +0x255
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.newRetryer
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/retry.go:94 +0x15d
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 208 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*netClientWorker).run(0xc00037e960)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/output.go:127 +0xcb
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.makeClientWorker
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/output.go:79 +0x196
Aug 30 14:33:46 Node1 metricbeat[106331]: rax 0x0
Aug 30 14:33:46 Node1 metricbeat[106331]: rbx 0x7f4ff3fff640
Aug 30 14:33:46 Node1 metricbeat[106331]: rcx 0x7f505ed6c9fc
Aug 30 14:33:46 Node1 metricbeat[106331]: rdx 0x6
Aug 30 14:33:46 Node1 metricbeat[106331]: rdi 0x19f5b
Aug 30 14:33:46 Node1 metricbeat[106331]: rsi 0x19f6a
Aug 30 14:33:46 Node1 metricbeat[106331]: rbp 0x19f6a
Aug 30 14:33:46 Node1 metricbeat[106331]: rsp 0x7f4ff3ffe7a0
Aug 30 14:33:46 Node1 metricbeat[106331]: r8 0x7f4ff3ffe870
Aug 30 14:33:46 Node1 metricbeat[106331]: r9 0x7fffffff
Aug 30 14:33:46 Node1 metricbeat[106331]: r10 0x8
Aug 30 14:33:46 Node1 metricbeat[106331]: r11 0x246
Aug 30 14:33:46 Node1 metricbeat[106331]: r12 0x6
Aug 30 14:33:46 Node1 metricbeat[106331]: r13 0x16
Aug 30 14:33:46 Node1 metricbeat[106331]: r14 0x563c60d09d54
Aug 30 14:33:46 Node1 metricbeat[106331]: r15 0x0
Aug 30 14:33:46 Node1 metricbeat[106331]: rip 0x7f505ed6c9fc
Aug 30 14:33:46 Node1 metricbeat[106331]: rflags 0x246
Aug 30 14:33:46 Node1 metricbeat[106331]: cs 0x33
Aug 30 14:33:46 Node1 metricbeat[106331]: fs 0x0
Aug 30 14:33:46 Node1 metricbeat[106331]: gs 0x0
Aug 30 14:33:47 Node1 systemd[1]: metricbeat.service: Scheduled restart job, restart counter is at 5.
░░ Subject: Automatic restarting of a unit has been scheduled
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ Automatic restarting of the unit metricbeat.service has been scheduled, as the result for
░░ the configured Restart= setting for the unit.
Aug 30 14:33:47 Node1 systemd[1]: Stopped Metricbeat is a lightweight shipper for metrics..
░░ Subject: A stop job for unit metricbeat.service has finished
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ A stop job for unit metricbeat.service has finished.
░░
░░ The job identifier is 68961 and the job result is done.
Aug 30 14:33:47 Node1 systemd[1]: metricbeat.service: Start request repeated too quickly.
Aug 30 14:33:47 Node1 systemd[1]: metricbeat.service: Failed with result ‘exit-code’.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ The unit metricbeat.service has entered the ‘failed’ state with result ‘exit-code’.
Aug 30 14:33:47 Node1 systemd[1]: Failed to start Metricbeat is a lightweight shipper for metrics..
░░ Subject: A start job for unit metricbeat.service has failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ A start job for unit metricbeat.service has finished with a failure.
░░
░░ The job identifier is 68961 and the job result is failed.I created a new slice but my beats are dying on the new slice as well even when I restart the service.
My Slice ID is: 622be3d2-cf07-4845-b484-a37f8fa4d39cHere is the output for
sudo systemctl status metricbeat
× metricbeat.service – Metricbeat is a lightweight shipper for metrics.Loaded: loaded (/lib/systemd/system/metricbeat.service; enabled; vendorpreset: enabled)Active: failed (Result: exit-code) sinceFri2024-08-3014:33:47UTC; 8minagoProcess: 106331ExecStart=/usr/share/metricbeat/bin/metricbeat–environmentsystemd $BEAT_LOG_OPTS $BEAT_CONFIG_OPTS $BEAT_PATH_OPTS (code=exited, status=2)MainPID: 106331 (code=exited, status=2)CPU: 444msAug 30 14:33:46 Node1 metricbeat[106331]: rip 0x7f505ed6c9fcAug 30 14:33:46 Node1 metricbeat[106331]: rflags 0x246Aug 30 14:33:46 Node1 metricbeat[106331]: cs 0x33Aug 30 14:33:46 Node1 metricbeat[106331]: fs 0x0Aug 30 14:33:46 Node1 metricbeat[106331]: gs 0x0Aug 30 14:33:47 Node1 systemd[1]: metricbeat.service: Scheduled restart job, restart counter is at 5.Aug 30 14:33:47 Node1 systemd[1]: Stopped Metricbeat is a lightweight shipper for metrics..Aug 30 14:33:47 Node1 systemd[1]: metricbeat.service: Start request repeated too quickly.Aug 30 14:33:47 Node1 systemd[1]: metricbeat.service: Failed with result ‘exit-code’.Aug 30 14:33:47 Node1 systemd[1]: Failed to start Metricbeat is a lightweight shipper for metrics..I can share more detailed output if that could help you.- This reply was modified 3 months, 1 week ago by Prateek Jain.
- This reply was modified 3 months, 1 week ago by Prateek Jain.
Hi Song,
Yes I checked and you are right.. the status for all my 3 beats was dead. I restarted all of them and it started working again.. is there any reason why that happened ? because I just configured everything yesterday and it was working fine. I didnot access my meas node or change any settings but this morning they just died.
Thanks!!
Thanks!
For now I have my IPs and I can access my machines. I reported this so that there is no issue in future.
Hi Komal,
Here is the slice ID of my slice for which I shared the screenshot:
7a43bc65-79be-4149-9e35-dce54ed05dee
Thanks Arash and Hussam!
Thanks, I will try that.
Thanks for the prompt reply!
I can definitely use this setup and commands to download my experiment results on my local machine but what I was trying to achieve was running the experiments on FABRIC, download the results from all my nodes to my jupyter hub and then conduct analysis on this data using a jupyter notebook. This would make the results of the experiments plottable as soon as the experiments are done.
This works fine when I conduct experiments with short durations. With long duration experiments the experimental data size increases and I am not able to download it on my jupyterhub for analysis. Is there any work around this issue other than downloading the results on my local machine and run jupyter notebook locally?Thanks! I will try that.
Sure.. if I face this issue again I will let you know with all the relevant details.
Hi,
When I execute the following command:
ip_addr_node3_node1 =node3.get_interface(network_name=node1_node3_l2_network_name).get_ip_addr() interface7 =node3.get_interface(network_name=node1_node3_l2_network_name).get_os_interface() print(ip_addr_node3_node1, interface7)
The output that I get is :
192.168.2.3 None
When I checked the interfaces and IP with “ip addr” command I could not see my interfaces.
I could be wrong in my conclusion that the interfaces are deleted but I definitely could not see/access them.
This has happened 2-3 times to me in the last 5-6 days. Next time the issue happens I will take the screen shot of the output as well. I can share the slice ID for the slice where I face this problem last time:
eb274fca-fd9a-42b9-9d67-96300ca8d23c
Unfortunately, the slice is dead now because I had to reserve nodes on the same sites and there were not enough resources available on these sites. Therefore, I deleted my slice, released the resources and then reserved a slice again.
Hey..
I am trying to access the link that you have provided for the OWL measurement
But now the link is not available… it says 404 not found..
Hi Mami.. I will try the approach that you suggested..
This is exactly what I want to do… I plan to send a tracer packet just before sending the file and after sending the file… and check my file transfer time.. I will be there at KNIT7 and if I could not figure out how to timestamp and check packet then I will definitely be in contact with the team working on it..
Thanks 🙂
-
AuthorPosts