ELK not getting live data

This topic has 9 replies, 2 voices, and was last updated 1 year, 1 month ago by Yongwook Song.

Viewing 10 posts - 1 through 10 (of 10 total)

Author

Posts
August 29, 2024 at 3:37 pm #7485
Prateek Jain
Participant
Hi,

I am trying to use FABRIC’s measurement framework to conduct some traffic analysis for the experiments that I am currently running on the slice 7a43bc65-79be-4149-9e35-dce54ed05dee

I have setup ELK and Prometheus both successfully but I cannot see my data in Kibana, however I can see the data in Prometheus (screenshots attached). I dont think my kibana setup has any issues as I ran the cells without error and my kibana discover tab shows data from earlier today (screenshot attached) but it does not show data for the experiments that I am running right now.

I can make prometheus work to get the analysis that I want but I am more familiar with kibana. It will be great if I could get my live data to kibana for analysis without exporting and importing it manually.
August 29, 2024 at 4:03 pm #7486
Yongwook Song
Participant
Hi, Prateek.

I do not see your screenshot for some reason. Could you attach the screenshot again if you can? Maybe the screenshot was too large.

Here are things you may check:
- Is the meas_node disk space is nearly full? If so, Elasticsearch may stop ingesting.
- Are the worker’s beats running without any error messages in the beats’ logs?
Thank you.

-Song
August 29, 2024 at 5:04 pm #7487
Prateek Jain
Participant
Hi Song,

Yes I checked and you are right.. the status for all my 3 beats was dead. I restarted all of them and it started working again.. is there any reason why that happened ? because I just configured everything yesterday and it was working fine. I didnot access my meas node or change any settings but this morning they just died.

Thanks!!
August 30, 2024 at 8:50 am #7488
Yongwook Song
Participant
If all the beats stopped for some reason, you can check the beats log to see what error caused the stop of running.

It may give you some reason in the logs. I would guess possible reasons such as network reset or temporary network connection issue.

If the workers restarted for some reason, then maybe the beats are not enrolled for auto restart when VM restarts. I would recommend to set auto-start of beat services when the VM restart (if that is not enabled).

Thank you.

-Song
August 30, 2024 at 10:42 am #7489
Prateek Jain
Participant
I created a new slice but my beats are dying on the new slice as well even when I restart the service.
My Slice ID is: 622be3d2-cf07-4845-b484-a37f8fa4d39c

Here is the output for sudo systemctl status metricbeat

× metricbeat.service – Metricbeat is a lightweight shipper for metrics.

Loaded: loaded (/lib/systemd/system/metricbeat.service; enabled; vendorpreset: enabled)

Active: failed (Result: exit-code) sinceFri2024-08-3014:33:47UTC; 8minago

Docs: https://www.elastic.co/beats/metricbeat

Process: 106331ExecStart=/usr/share/metricbeat/bin/metricbeat–environmentsystemd $BEAT_LOG_OPTS $BEAT_CONFIG_OPTS $BEAT_PATH_OPTS (code=exited, status=2)

MainPID: 106331 (code=exited, status=2)

CPU: 444ms

Aug 30 14:33:46 Node1 metricbeat[106331]: rip 0x7f505ed6c9fc

Aug 30 14:33:46 Node1 metricbeat[106331]: rflags 0x246

Aug 30 14:33:46 Node1 metricbeat[106331]: cs 0x33

Aug 30 14:33:46 Node1 metricbeat[106331]: fs 0x0

Aug 30 14:33:46 Node1 metricbeat[106331]: gs 0x0

Aug 30 14:33:47 Node1 systemd[1]: metricbeat.service: Scheduled restart job, restart counter is at 5.

Aug 30 14:33:47 Node1 systemd[1]: Stopped Metricbeat is a lightweight shipper for metrics..

Aug 30 14:33:47 Node1 systemd[1]: metricbeat.service: Start request repeated too quickly.

Aug 30 14:33:47 Node1 systemd[1]: metricbeat.service: Failed with result ‘exit-code’.

Aug 30 14:33:47 Node1 systemd[1]: Failed to start Metricbeat is a lightweight shipper for metrics..

I can share more detailed output if that could help you.
- This reply was modified 1 year, 2 months ago by Prateek Jain.
- This reply was modified 1 year, 2 months ago by Prateek Jain.
August 30, 2024 at 10:51 am #7492
Yongwook Song
Participant
Could you share logs from the /var/log? There should be metricbeat logs that may have more information about what caused the issue.

-Song
August 30, 2024 at 10:59 am #7493
Prateek Jain
Participant
I cannot see any specific log files for metricbeat in /var/log but here is the output for journalctl -xeu metricbeat.service

Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.(*ackLoop).run(0xc000bc6c30)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/ackloop.go:60 +0x118
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.NewQueue.func2(0xc000217650, 0xc000bc6c30)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:180 +0x5b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.NewQueue
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:178 +0x405
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 194 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.(*consumer).Get(0xc000baf800, 0x32, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/consume.go:65 +0xf1
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*eventConsumer).loop(0xc000e340c0, 0x55aa7a220140, 0xc000baf800)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:182 +0x1a2
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.newEventConsumer.func1(0xc000e340c0, 0x55aa7a220140, 0xc000baf7e0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:86 +0x6e
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.newEventConsumer
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:84 +0x153
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 195 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*retryer).loop(0xc000e341e0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/retry.go:135 +0x255
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.newRetryer
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/retry.go:94 +0x15d
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 196 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*netClientWorker).run(0xc000e343c0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/output.go:127 +0xcb
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.makeClientWorker
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/output.go:79 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1564 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/monitoring/report/log.(*reporter).snapshotLoop(0xc001270570)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/monitoring/report/log/log.go:128 +0x40a
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/monitoring/report/log.MakeReporter.func1(0xc001270570)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/monitoring/report/log/log.go:106 +0x52
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/libbeat/monitoring/report/log.MakeReporter
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/monitoring/report/log/log.go:104 +0x15f
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 197 [syscall]:
Aug 30 14:33:46 Node1 metricbeat[106288]: os/signal.signal_recv(0x0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sigqueue.go:147 +0x9e
Aug 30 14:33:46 Node1 metricbeat[106288]: os/signal.loop()
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/os/signal/signal_unix.go:23 +0x25
Aug 30 14:33:46 Node1 metricbeat[106288]: created by os/signal.Notify.func1.1
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/os/signal/signal.go:150 +0x46
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 152 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001264ab0, 0xc0005c6de0, 0xc0007bdc80)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588a70, 0xc0005c6de0, 0xc0007bdc80, 0xc001264ab0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 153 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588a78)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588a70)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588a70, 0xc0007bdc80, 0xc001224410)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 154 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc0005f78e8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc0005f78e0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc0005bd830, 0xc00058ffa8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc0012244b0, 0xc0007bdc80)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 155 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001264e10, 0xc0005c6f00, 0xc0007bdd40)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588a80, 0xc0005c6f00, 0xc0007bdd40, 0xc001264e10)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 156 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588a88)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588a80)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588a80, 0xc0007bdd40, 0xc001224500)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 157 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000e2e268)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000e2e260)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc0005bdb00, 0xc0012877a8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc0012245a0, 0xc0007bdd40)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 158 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001265170, 0xc0005c7020, 0xc0007bde00)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588a90, 0xc0005c7020, 0xc0007bde00, 0xc001265170)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 159 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588a98)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588a90)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588a90, 0xc0007bde00, 0xc0012245f0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 160 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000e2e258)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000e2e250)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc0005bddd0, 0xc000bbefa8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc001224690, 0xc0007bde00)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 161 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc0012654d0, 0xc0005c7140, 0xc0007bdec0)
Aug 30 14:33:46 Node1 systemd[1]: metricbeat.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ An ExecStart= process belonging to unit metricbeat.service has exited.
░░
░░ The process’ exit code is ‘exited’ and its exit status is 2.
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588aa0, 0xc0005c7140, 0xc0007bdec0, 0xc0012654d0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1570 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588aa8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588aa0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588aa0, 0xc0007bdec0, 0xc0012246e0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1571 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000e2e2a8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000e2e2a0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc00126a120, 0xc0012827a8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc001224780, 0xc0007bdec0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1572 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001265830, 0xc0005c7260, 0xc0007fc000)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588ab0, 0xc0005c7260, 0xc0007fc000, 0xc001265830)
Aug 30 14:33:46 Node1 systemd[1]: metricbeat.service: Failed with result ‘exit-code’.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ The unit metricbeat.service has entered the ‘failed’ state with result ‘exit-code’.
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1573 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588ab8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588ab0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588ab0, 0xc0007fc000, 0xc0012247d0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1574 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000e2e2b8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000e2e2b0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc00126a3f0, 0xc001283fa8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc001224870, 0xc0007fc000)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1575 [runnable]:
Aug 30 14:33:46 Node1 metricbeat[106288]: bytes.makeSlice.func1()
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/bytes/buffer.go:224 +0x6b
Aug 30 14:33:46 Node1 metricbeat[106288]: bytes.makeSlice(0x200, 0xc001500000, 0x200, 0x200)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/bytes/buffer.go:229 +0x98
Aug 30 14:33:46 Node1 metricbeat[106288]: bytes.(*Buffer).grow(0xc000b23500, 0x200, 0xc)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/bytes/buffer.go:142 +0x156
Aug 30 14:33:46 Node1 metricbeat[106288]: bytes.(*Buffer).Grow(…)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/bytes/buffer.go:161
Aug 30 14:33:46 Node1 metricbeat[106288]: io/ioutil.readAll(0x55aa7a1f87e0, 0xc001380008, 0x200, 0x0, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/io/ioutil/ioutil.go:34 +0xa5
Aug 30 14:33:46 Node1 metricbeat[106288]: io/ioutil.ReadFile(0xc00138e110, 0xc, 0x0, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/io/ioutil/ioutil.go:73 +0xef
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/gosigar.readProcFile(0x8, 0x55aa78bf44ce, 0x4, 0x0, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/pkg/mod/github.com/elastic/gosigar@v0.14.1/sigar_linux_common.go:414 +0x154
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/gosigar.(*ProcState).Get(0xc001382060, 0x8, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/pkg/mod/github.com/elastic/gosigar@v0.14.1/sigar_linux_common.go:158 +0x5a
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/module/system/process_summary.(*MetricSet).Fetch(0xc00125c1e0, 0x7f4b183b9068, 0xc000824600, 0x7f4b183b9068, 0xc000824600)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/module/system/process_summary/process_summary.go:82 +0xff
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).fetch(0xc001265b90, 0x55aa7a268040, 0xc000826038, 0x55aa7a247c00, 0xc000824600)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:256 +0x3a7
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).startPeriodicFetching(0xc001265b90, 0x55aa7a268040, 0xc000826038, 0x55aa7a247c00, 0xc000824600)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:224 +0x8d
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001265b90, 0xc0005c7380, 0xc0007fc0c0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:208 +0x848
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588ac0, 0xc0005c7380, 0xc0007fc0c0, 0xc001265b90)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1576 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588ac8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588ac0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588ac0, 0xc0007fc0c0, 0xc0012248c0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1577 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588b68)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588b60)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc00126a6c0, 0xc0012857a8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc001224960, 0xc0007fc0c0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1578 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001265ef0, 0xc0005c74a0, 0xc0007fc180)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588ad0, 0xc0005c74a0, 0xc0007fc180, 0xc001265ef0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1579 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588ad8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588ad0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588ad0, 0xc0007fc180, 0xc0012249b0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1580 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000834018)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000834010)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc00126a990, 0xc00128efa8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc001224a50, 0xc0007fc180)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1581 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*metricSetWrapper).run(0xc001270270, 0xc0005c75c0, 0xc0007fc240)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:182 +0xc0c
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func1(0xc000588ae0, 0xc0005c75c0, 0xc0007fc240, 0xc001270270)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:147 +0x25b
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:135 +0x146
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1582 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588ae8)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588ae0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start.func2(0xc000588ae0, 0xc0007fc240, 0xc001224aa0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:153 +0x31
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*Wrapper).Start
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/wrapper.go:152 +0x196
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1583 [semacquire]:
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.runtime_Semacquire(0xc000588b88)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/runtime/sema.go:56 +0x45
Aug 30 14:33:46 Node1 metricbeat[106288]: sync.(*WaitGroup).Wait(0xc000588b80)
Aug 30 14:33:46 Node1 metricbeat[106288]: /usr/local/go/src/sync/waitgroup.go:130 +0x66
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels(0x55aa7a2478c0, 0xc00126ac60, 0xc0012807a8, 0x1, 0x1)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:51 +0xf3
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1.1(0xc001224b40, 0xc0007fc240)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:82 +0x96
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.(*runner).Start.func1
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/runner.go:80 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1584 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run.func1(0xc000588a60, 0xc00020c0e0, 0x55aa7a247c80, 0xc001270540)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:214 +0x65
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:212 +0x10b
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1585 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run.func2(0xc000588a60, 0xc00020c0e0, 0xc0007ec500)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:226 +0x65
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:224 +0x371
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 199 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels.func1(0xc0007bdd40)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:40 +0x158
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:48 +0xd2
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1586 [select]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/libbeat/cfgfile.(*Reloader).Run(0xc0007fc420, 0x55aa7a220480, 0xc0007ea5b0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/libbeat/cfgfile/reload.go:188 +0x230
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:238 +0x4e5
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1587 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run.func3(0xc000588a60, 0xc00020c0e0, 0xc0007fc420)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:242 +0x65
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/beater.(*Metricbeat).Run
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:240 +0x53b
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1588 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels.func1(0xc0007fc0c0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:40 +0x158
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:48 +0xd2
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 200 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels.func1(0xc0007bdec0)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:40 +0x158
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:48 +0xd2
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1589 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels.func1(0xc0007fc240)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:40 +0x158
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:48 +0xd2
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 201 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels.func1(0xc0007fc000)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:40 +0x158
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:48 +0xd2
Aug 30 14:33:46 Node1 metricbeat[106288]: goroutine 1566 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106288]: github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels.func1(0xc0007bdc80)
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:40 +0x158
Aug 30 14:33:46 Node1 metricbeat[106288]: created by github.com/elastic/beats/v7/metricbeat/mb/module.PublishChannels
Aug 30 14:33:46 Node1 metricbeat[106288]: /go/src/github.com/elastic/beats/metricbeat/mb/module/publish.go:48 +0xd2
Aug 30 14:33:46 Node1 metricbeat[106288]: rax 0x0
Aug 30 14:33:46 Node1 metricbeat[106288]: rbx 0x7f4b027fc640
Aug 30 14:33:46 Node1 metricbeat[106288]: rcx 0x7f4b5a00f9fc
Aug 30 14:33:46 Node1 metricbeat[106288]: rdx 0x6
Aug 30 14:33:46 Node1 metricbeat[106288]: rdi 0x19f30
Aug 30 14:33:46 Node1 metricbeat[106288]: rsi 0x19f41
Aug 30 14:33:46 Node1 metricbeat[106288]: rbp 0x19f41
Aug 30 14:33:46 Node1 metricbeat[106288]: rsp 0x7f4b027fb7a0
Aug 30 14:33:46 Node1 metricbeat[106288]: r8 0x7f4b027fb870
Aug 30 14:33:46 Node1 metricbeat[106288]: r9 0x7fffffff
Aug 30 14:33:46 Node1 metricbeat[106288]: r10 0x8
Aug 30 14:33:46 Node1 metricbeat[106288]: r11 0x246
Aug 30 14:33:46 Node1 metricbeat[106288]: r12 0x6
Aug 30 14:33:46 Node1 metricbeat[106288]: r13 0x16
Aug 30 14:33:46 Node1 metricbeat[106288]: r14 0x55aa79109d54
Aug 30 14:33:46 Node1 metricbeat[106288]: r15 0x0
Aug 30 14:33:46 Node1 metricbeat[106288]: rip 0x7f4b5a00f9fc
Aug 30 14:33:46 Node1 metricbeat[106288]: rflags 0x246
Aug 30 14:33:46 Node1 metricbeat[106288]: cs 0x33
Aug 30 14:33:46 Node1 metricbeat[106288]: fs 0x0
Aug 30 14:33:46 Node1 metricbeat[106288]: gs 0x0
Aug 30 14:33:46 Node1 systemd[1]: metricbeat.service: Scheduled restart job, restart counter is at 4.
░░ Subject: Automatic restarting of a unit has been scheduled
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ Automatic restarting of the unit metricbeat.service has been scheduled, as the result for
░░ the configured Restart= setting for the unit.
Aug 30 14:33:46 Node1 systemd[1]: Stopped Metricbeat is a lightweight shipper for metrics..
░░ Subject: A stop job for unit metricbeat.service has finished
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ A stop job for unit metricbeat.service has finished.
░░
░░ The job identifier is 68880 and the job result is done.
Aug 30 14:33:46 Node1 systemd[1]: Started Metricbeat is a lightweight shipper for metrics..
░░ Subject: A start job for unit metricbeat.service has finished successfully
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ A start job for unit metricbeat.service has finished successfully.
░░
░░ The job identifier is 68880.
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.822Z INFO instance/beat.go:665 Home path: [/usr/share/metricbeat] Config path: [/etc/metricbeat] Data path: [/var/lib/metricbeat] Logs path: [/var/log/metricbeat]
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.822Z INFO instance/beat.go:673 Beat ID: ff5dc2c4-6d10-4f6e-a90a-3bc163f8b010
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.840Z INFO [seccomp] seccomp/seccomp.go:124 Syscall filter successfully installed
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.840Z INFO [beat] instance/beat.go:1014 Beat info {“system_info”: {“beat”: {“path”: {“config”: “/etc/metricbeat”, “data”: “/var/lib/metricbeat”, “home”: “/usr/share/metricbeat”, “logs”: “/var/log/metricbeat”}, “type”: “metricbeat”, “uuid”: “ff5dc2c4-6d10-4f6e-a90a-3bc163f8b010”}}}
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.840Z INFO [beat] instance/beat.go:1023 Build info {“system_info”: {“build”: {“commit”: “686ba416a74193f2e69dcfa2eb142f4364a79307”, “libbeat”: “7.13.2”, “time”: “2021-06-10T21:16:02.000Z”, “version”: “7.13.2”}}}
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.840Z INFO [beat] instance/beat.go:1026 Go runtime info {“system_info”: {“go”: {“os”:”linux”,”arch”:”amd64″,”max_procs”:48,”version”:”go1.15.13″}}}
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.842Z INFO [beat] instance/beat.go:1030 Host info {“system_info”: {“host”: {“architecture”:”x86_64″,”boot_time”:”2024-08-30T03:10:02Z”,”containerized”:false,”name”:”Node1″,”ip”:[“127.0.0.1/8″,”10.0.1.10/32″,”::1/128″,”10.20.5.221/23″,”fe80::f816:3eff:fe4a:8971/64″,”10.146.3.2/24″,”fe80::2d:8ff:fe2e:e28e/64″,”192.168.4.2/24″,”fe80::1018:85ff:fe14:b18f/64″,”192.168.2.2/24″,”fe80::1032:a0ff:fe2d:ec01/64″,”192.168.8.2/24″,”fe80::105b:34ff:fe9b:b3e/64″,”10.146.5.2/24″,”fe80::14ec:1dff:fe91:aa06/64″,”192.168.3.2/24″,”fe80::1802:ccff:feb9:bd5f/64″,”172.17.0.1/16″],”kernel_version”:”5.15.0-112-generic”,”mac”:[“fa:16:3e:4a:89:71″,”02:2d:08:2e:e2:8e”,”12:18:85:14:b1:8f”,”12:32:a0:2d:ec:01″,”12:5b:34:9b:0b:3e”,”16:ec:1d:91:aa:06″,”1a:02:cc:b9:bd:5f”,”02:42:5e:2d:c3:53″],”os”:{“type”:”linux”,”family”:”debian”,”platform”:”ubuntu”,”name”:”Ubuntu”,”version”:”22.04.4 LTS (Jammy Jellyfish)”,”major”:22,”minor”:4,”patch”:4,”codename”:”jammy”},”timezone”:”UTC”,”timezone_offset_sec”:0,”id”:”7761b545b6194557943b3b9f0eb83d71″}}}
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.843Z INFO [beat] instance/beat.go:1059 Process info {“system_info”: {“process”: {“capabilities”: {“inheritable”:null,”permitted”:[“chown”,”dac_override”,”dac_read_search”,”fowner”,”fsetid”,”kill”,”setgid”,”setuid”,”setpcap”,”linux_immutable”,”net_bind_service”,”net_broadcast”,”net_admin”,”net_raw”,”ipc_lock”,”ipc_owner”,”sys_module”,”sys_rawio”,”sys_chroot”,”sys_ptrace”,”sys_pacct”,”sys_admin”,”sys_boot”,”sys_nice”,”sys_resource”,”sys_time”,”sys_tty_config”,”mknod”,”lease”,”audit_write”,”audit_control”,”setfcap”,”mac_override”,”mac_admin”,”syslog”,”wake_alarm”,”block_suspend”,”audit_read”,”38″,”39″,”40″],”effective”:[“chown”,”dac_override”,”dac_read_search”,”fowner”,”fsetid”,”kill”,”setgid”,”setuid”,”setpcap”,”linux_immutable”,”net_bind_service”,”net_broadcast”,”net_admin”,”net_raw”,”ipc_lock”,”ipc_owner”,”sys_module”,”sys_rawio”,”sys_chroot”,”sys_ptrace”,”sys_pacct”,”sys_admin”,”sys_boot”,”sys_nice”,”sys_resource”,”sys_time”,”sys_tty_config”,”mknod”,”lease”,”audit_write”,”audit_control”,”setfcap”,”mac_override”,”mac_admin”,”syslog”,”wake_alarm”,”block_suspend”,”audit_read”,”38″,”39″,”40″],”bounding”:[“chown”,”dac_override”,”dac_read_search”,”fowner”,”fsetid”,”kill”,”setgid”,”setuid”,”setpcap”,”linux_immutable”,”net_bind_service”,”net_broadcast”,”net_admin”,”net_raw”,”ipc_lock”,”ipc_owner”,”sys_module”,”sys_rawio”,”sys_chroot”,”sys_ptrace”,”sys_pacct”,”sys_admin”,”sys_boot”,”sys_nice”,”sys_resource”,”sys_time”,”sys_tty_config”,”mknod”,”lease”,”audit_write”,”audit_control”,”setfcap”,”mac_override”,”mac_admin”,”syslog”,”wake_alarm”,”block_suspend”,”audit_read”,”38″,”39″,”40″],”ambient”:null}, “cwd”: “/”, “exe”: “/usr/share/metricbeat/bin/metricbeat”, “name”: “metricbeat”, “pid”: 106331, “ppid”: 1, “seccomp”: {“mode”:”filter”,”no_new_privs”:true}, “start_time”: “2024-08-30T14:33:46.140Z”}}}
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.843Z INFO instance/beat.go:309 Setup Beat: metricbeat; Version: 7.13.2
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.843Z INFO [index-management] idxmgmt/std.go:184 Set output.elasticsearch.index to ‘metricbeat-7.13.2’ as ILM is enabled.
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.843Z INFO eslegclient/connection.go:99 elasticsearch url: http://10.136.130.2:9200
Aug 30 14:33:46 Node1 metricbeat[106331]: 2024-08-30T14:33:46.843Z INFO [publisher] pipeline/module.go:113 Beat name: Node1
Aug 30 14:33:46 Node1 metricbeat[106331]: runtime/cgo: pthread_create failed: Operation not permitted
Aug 30 14:33:46 Node1 metricbeat[106331]: SIGABRT: abort
Aug 30 14:33:46 Node1 metricbeat[106331]: PC=0x7f505ed6c9fc m=16 sigcode=18446744073709551610
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 0 [idle]:
Aug 30 14:33:46 Node1 metricbeat[106331]: runtime: unknown pc 0x7f505ed6c9fc
Aug 30 14:33:46 Node1 metricbeat[106331]: stack: frame={sp:0x7f4ff3ffe7a0, fp:0x0} stack=[0x7f4ff37ff1e8,0x7f4ff3ffede8)
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6a0: 0000000001a37897 0000563c6073639c
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6b0: 0000000000000000 0000563c5daa3c1e <runtime.callCgoMmap+62>
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6c0: 00007f4ff3ffe6c8 00007f4ff3ffe758
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6d0: 0000563c5da5059b <runtime.scanframeworker+155> 00007f4ff3ffe718
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6e0: 0000563c5da94f1a <runtime.mmap.func1+90> 0000000000000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6f0: 0000000000040000 0000002200000003
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe700: 00000000ffffffff 00007f50340fb000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe710: 00007f4ff3ffe758 00007f4ff3ffe790
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe720: 0000563c5da3349e <runtime.mmap+158> 00007f4ff3ffe760
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe730: 0000000000000000 0000000000000130
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe740: 0000000000000000 0000563c00000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe750: 000000135daa1e80 0000000000000120
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe760: 0000563c5da94ec0 <runtime.mmap.func1+0> 0000000000000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe770: 0000000000040000 0000002200000003
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe780: 0000000000000004 0000003400000013
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe790: 0000000000000000 00007f505ed6c9ee
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7a0: <0000000000000000 000000770000007c
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7b0: 0000005b0000006e 00000000ffffffff
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7c0: 00007f50340fb000 00007f505edfc8a1
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7d0: 00007f4ff17fa640 00007f4ff3ffeab0
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7e0: 00007f4ff3ffe92e 00007f4ff3ffe92f
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7f0: 0000000000000000 00007f505ed6a6d9
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe800: 00000000007fff00 0000000000000008
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe810: 00000000003d0f00 00007f4ff17fa910
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe820: 00007f4ff17fa910 e9bba71dae960200
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe830: 00007f4ff3fff640 0000000000000006
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe840: 00000000000000f1 0000000000000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe850: 0000563c60d09d54 00007f505ed18476
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe860: 00007f505eef1e90 00007f505ecfe7f3
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe870: 0000000000000020 00007f4ff17fa640
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe880: 0000000000000000 0000000000000001
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe890: 00007f4ff17fa640 00007f505ed6b544
Aug 30 14:33:46 Node1 metricbeat[106331]: runtime: unknown pc 0x7f505ed6c9fc
Aug 30 14:33:46 Node1 metricbeat[106331]: stack: frame={sp:0x7f4ff3ffe7a0, fp:0x0} stack=[0x7f4ff37ff1e8,0x7f4ff3ffede8)
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6a0: 0000000001a37897 0000563c6073639c
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6b0: 0000000000000000 0000563c5daa3c1e <runtime.callCgoMmap+62>
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6c0: 00007f4ff3ffe6c8 00007f4ff3ffe758
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6d0: 0000563c5da5059b <runtime.scanframeworker+155> 00007f4ff3ffe718
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6e0: 0000563c5da94f1a <runtime.mmap.func1+90> 0000000000000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe6f0: 0000000000040000 0000002200000003
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe700: 00000000ffffffff 00007f50340fb000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe710: 00007f4ff3ffe758 00007f4ff3ffe790
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe720: 0000563c5da3349e <runtime.mmap+158> 00007f4ff3ffe760
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe730: 0000000000000000 0000000000000130
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe740: 0000000000000000 0000563c00000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe750: 000000135daa1e80 0000000000000120
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe760: 0000563c5da94ec0 <runtime.mmap.func1+0> 0000000000000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe770: 0000000000040000 0000002200000003
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe780: 0000000000000004 0000003400000013
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe790: 0000000000000000 00007f505ed6c9ee
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7a0: <0000000000000000 000000770000007c
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7b0: 0000005b0000006e 00000000ffffffff
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7c0: 00007f50340fb000 00007f505edfc8a1
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7d0: 00007f4ff17fa640 00007f4ff3ffeab0
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7e0: 00007f4ff3ffe92e 00007f4ff3ffe92f
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe7f0: 0000000000000000 00007f505ed6a6d9
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe800: 00000000007fff00 0000000000000008
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe810: 00000000003d0f00 00007f4ff17fa910
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe820: 00007f4ff17fa910 e9bba71dae960200
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe830: 00007f4ff3fff640 0000000000000006
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe840: 00000000000000f1 0000000000000000
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe850: 0000563c60d09d54 00007f505ed18476
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe860: 00007f505eef1e90 00007f505ecfe7f3
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe870: 0000000000000020 00007f4ff17fa640
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe880: 0000000000000000 0000000000000001
Aug 30 14:33:46 Node1 metricbeat[106331]: 00007f4ff3ffe890: 00007f4ff17fa640 00007f505ed6b544
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 1 [runnable]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.parseVarExp(0xc0003440c0, 0x563c607f244d, 0x1, 0xc000344120, 0xc000868000, 0x120, 0x110)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/variables.go:451 +0xd79
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.parseSplice(0xc0005c6280, 0x1d, 0x563c607f244d, 0x1, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/variables.go:347 +0xd8
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeString(0x0, 0x0, 0x0, 0x0, 0xc00059e3f0, 0xc0005c6280, 0x1d, 0x7f505ec959b8, 0xc00084c0d0, 0x563c5da32e7c, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:518 +0x76
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeValue(0xc00059e3f0, 0xc000000000, 0x0, 0x0, 0x0, 0x0, 0x563c6148af60, 0xc00084c0e0, 0x94, 0x563c5db10b0a, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:489 +0xd53
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeSetField(0xc000592de0, 0xc00059e3f0, 0x0, 0xc0005fc078, 0x4, 0x563c6148af60, 0xc00084c0e0, 0x94, 0x94, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:377 +0x9a
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeMapInto(0xc000592de0, 0xc00059e3f0, 0x563c6152be00, 0xc000592cc0, 0x15, 0x563c6130d0c0, 0x563c6152be00)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:313 +0x238
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeMap(0xc00059e3f0, 0x563c6152be00, 0xc000592cc0, 0x15, 0xc000592cc0, 0x15, 0x14)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:295 +0xaa
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeMapValue(0xc00059e3f0, 0x563c61eadd40, 0xc000592db0, 0x563c63c57cc0, 0x1, 0x563c6152be00, 0xc000592cc0, 0x15, 0x1, 0x563c5daad985, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:416 +0x52
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeValue(0xc00059e3f0, 0xc000000000, 0x563c61eadd40, 0xc000592db0, 0x563c63c57cc0, 0x1, 0x563c6148af60, 0xc000590710, 0x194, 0x563c5da4515b, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:493 +0xa2f
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeArray(0xc00059e3f0, 0x563c61000000, 0x0, 0x0, 0x0, 0x0, 0x563c6130d0c0, 0xc0005f4300, 0x97, 0x563c5da32e7c, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:445 +0x2e5
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeValue(0xc00059e3f0, 0xc000000000, 0x0, 0x0, 0x0, 0x0, 0x563c6148af60, 0xc0005907f0, 0x94, 0x563c5db10b0a, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:491 +0x97c
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeSetField(0xc000592d80, 0xc00059e3f0, 0x0, 0xc0005fc050, 0xa, 0x563c6148af60, 0xc0005907f0, 0x94, 0x94, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:377 +0x9a
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeMapInto(0xc000592d80, 0xc00059e3f0, 0x563c6152be00, 0xc000592c90, 0x15, 0xc000c60378, 0xc000592c90)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:313 +0x238
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalizeMap(0xc00059e3f0, 0x563c6152be00, 0xc000592c90, 0x15, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:295 +0xaa
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.normalize(0xc00059e3f0, 0x563c6152be00, 0xc000592c90, 0xc00059e3f0, 0x563c61737320, 0x563c60d0807e)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:277 +0x2fc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.(*Config).Merge(0xc000592cf0, 0x563c6152be00, 0xc000592c90, 0xc000592ba0, 0x5, 0x6, 0x563c61d4a758, 0xc000c60458)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/merge.go:79 +0x7a
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg.NewFrom(0x563c6152be00, 0xc000592c90, 0xc000592ba0, 0x5, 0x6, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/ucfg.go:105 +0xa5
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg/yaml.NewConfig(0xc001592000, 0x5a, 0x25a, 0xc000592ba0, 0x5, 0x6, 0x1, 0x6, 0xc000c604f8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/yaml/yaml.go:35 +0xe6
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/go-ucfg/yaml.NewConfigWithFile(0xc00158e000, 0x2c, 0xc000631920, 0x4, 0x6, 0xc000c60570, 0x563c5dae662f, 0xc00158e000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/elastic/go-ucfg@v0.8.3/yaml/yaml.go:48 +0x168
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common.LoadFile(0xc00158e000, 0x2c, 0x563c61e86340, 0xc001590000, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/config.go:152 +0x87
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/mb.(*LightModulesSource).loadModuleConfig(0xc000897920, 0xc00158e000, 0x2c, 0xc00158e000, 0x2c, 0xc0004da001)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/mb/lightmodules.go:211 +0x4f
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/mb.(*LightModulesSource).loadModule(0xc000897920, 0xc00032c040, 0xc0008d9a5d, 0x4, 0xc0012c9a40, 0xb, 0x73)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/mb/lightmodules.go:187 +0x96
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/mb.(*LightModulesSource).MetricSets(0xc000897920, 0xc00032c040, 0xc0008d9a5d, 0x4, 0x2, 0xc0005c6120, 0x11, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/mb/lightmodules.go:90 +0x6c
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/mb.(*LightModulesSource).ModulesInfo(0xc000897920, 0xc00032c040, 0xc00139eb30, 0x2)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/mb/lightmodules.go:145 +0x189
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/mb.(*Register).String(0xc00032c040, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/mb/registry.go:433 +0x7cc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/beater.newMetricbeat(0xc000660e00, 0xc000715d10, 0xc000938470, 0x2, 0x2, 0x563c5f16f753, 0xc0005a82a0, 0x563c61d4bcb8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:151 +0x1e5
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/metricbeat/beater.Creator.func1(0xc000660e00, 0xc000715d10, 0x6, 0x563c61dfa6e0, 0xc0008978a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/metricbeat/beater/metricbeat.go:81 +0x52
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).createBeater(0xc000660e00, 0xc0007810e0, 0x0, 0x24, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:377 +0x799
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/cmd/instance.(*Beat).launch(0xc000660e00, 0x563c608032b5, 0xa, 0x563c608032b5, 0xa, 0x0, 0x0, 0x101, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:440 +0x4b9
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/cmd/instance.Run.func1(0x563c608032b5, 0xa, 0x563c608032b5, 0xa, 0x0, 0x0, 0x101, 0xc00139fc20, 0xc0007810e0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:196 +0x5a8
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/cmd/instance.Run(0x563c608032b5, 0xa, 0x563c608032b5, 0xa, 0x0, 0x0, 0x101, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/cmd/instance/beat.go:197 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/cmd.genRunCmd.func1(0xc000155340, 0xc000157080, 0x0, 0xc)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/cmd/run.go:36 +0x85
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/spf13/cobra.(*Command).execute(0xc000155340, 0xc0000501b0, 0xc, 0xc, 0xc000155340, 0xc0000501b0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:830 +0x2c2
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/spf13/cobra.(*Command).ExecuteC(0xc000155340, 0x0, 0xffffffff, 0xc000112058)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:914 +0x30b
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/spf13/cobra.(*Command).Execute(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/spf13/cobra@v0.0.5/command.go:864
Aug 30 14:33:46 Node1 metricbeat[106331]: main.main()
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/x-pack/metricbeat/main.go:21 +0x31
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 41 [IO wait]:
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d59f0, 0x77, 0xc0002de180)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc000f14098, 0x77, 0x563c61e67900, 0xc0003ec300, 0xc000f14080)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitWrite(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:96
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).WaitWrite(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:508
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).connect(0xc000f14080, 0x563c61e67980, 0xc0003ec300, 0x0, 0x0, 0x563c61df8a00, 0xc0007ec020, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_unix.go:141 +0x26d
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).dial(0xc000f14080, 0x563c61e67980, 0xc0003ec300, 0x563c61e86220, 0x0, 0x563c61e86220, 0xc0007e0180, 0x0, 0x6564202020202001, 0xc000c19408)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/sock_posix.go:149 +0x108
Aug 30 14:33:46 Node1 metricbeat[106331]: net.socket(0x563c61e67980, 0xc0003ec300, 0x563c607f322f, 0x3, 0x2, 0x1, 0x0, 0x0, 0x563c61e86220, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/sock_posix.go:70 +0x1c5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.internetSocket(0x563c61e67980, 0xc0003ec300, 0x563c607f322f, 0x3, 0x563c61e86220, 0x0, 0x563c61e86220, 0xc0007e0180, 0x1, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/ipsock_posix.go:141 +0x145
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*sysDialer).doDialTCP(0xc000f14000, 0x563c61e67980, 0xc0003ec300, 0x0, 0xc0007e0180, 0x563c615672c0, 0x563c63e41638, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/tcpsock_posix.go:65 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*sysDialer).dialTCP(0xc000f14000, 0x563c61e67980, 0xc0003ec300, 0x0, 0xc0007e0180, 0x563c5dbadd00, 0x563c607f322f, 0x7f503577d008)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/tcpsock_posix.go:61 +0xd9
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*sysDialer).dialSingle(0xc000f14000, 0x563c61e67980, 0xc0003ec300, 0x563c61e27940, 0xc0007e0180, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/dial.go:580 +0x5e5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*sysDialer).dialSerial(0xc000f14000, 0x563c61e67980, 0xc0003ec300, 0xc000f0e040, 0x1, 0x1, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/dial.go:548 +0x154
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*Dialer).DialContext(0xc0003ec1e0, 0x563c61e67980, 0xc0003ec300, 0x563c607f322f, 0x3, 0xc0007ec000, 0x13, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/dial.go:425 +0x6f7
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).dial(0xc000588000, 0x563c61e67980, 0xc0003ec300, 0x563c607f322f, 0x3, 0xc0007ec000, 0x13, 0x0, 0x7974202020202020, 0x74786574203a6570, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1144 +0x1fd
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).dialConn(0xc000588000, 0x563c61e67980, 0xc0003ec300, 0x0, 0xc0008899c0, 0x5, 0xc0007ec000, 0x13, 0x0, 0xc000f12000, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1582 +0x1adb
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).dialConnFor(0xc000588000, 0xc0007ee000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1424 +0xc8
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).queueForDial
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1393 +0x40f
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 42 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).connect.func2(0x563c61e67980, 0xc0003ec300, 0xc000f14080, 0xc0001124e0, 0xc000112480)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_unix.go:118 +0xc5
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net.(*netFD).connect
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_unix.go:117 +0x245
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 86 [chan receive]:
Aug 30 14:33:46 Node1 metricbeat[106331]: k8s.io/klog/v2.(*loggingT).flushDaemon(0x563c63e0b6e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/k8s.io/klog/v2@v2.2.0/klog.go:1131 +0x8d
Aug 30 14:33:46 Node1 metricbeat[106331]: created by k8s.io/klog/v2.init.0
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/k8s.io/klog/v2@v2.2.0/klog.go:416 +0xd8
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 87 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor.func1(0xc0005bb7c0, 0xc0005bb680)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:245 +0xbd
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:243 +0x94
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 88 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor.func1(0xc0005bb810, 0xc0005bb6d0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:245 +0xbd
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:243 +0x94
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 89 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor.func1(0xc0005bb860, 0xc0005bb720)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:245 +0xbd
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:243 +0x94
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 90 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor.func1(0xc0005bb8b0, 0xc0005bb770)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:245 +0xbd
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/common.(*Cache).StartJanitor
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/cache.go:243 +0x94
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 58 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: go.opencensus.io/stats/view.(*worker).start(0xc000917d60)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/go.opencensus.io@v0.22.2/stats/view/worker.go:154 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: created by go.opencensus.io/stats/view.init.0
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/go.opencensus.io@v0.22.2/stats/view/worker.go:32 +0x59
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 114 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata(0xc000a1ba10, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:163 +0x4cc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).init.func1()
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/add_cloud_metadata.go:99 +0x45
Aug 30 14:33:46 Node1 metricbeat[106331]: sync.(*Once).doSlow(0xc000a1ba10, 0xc00024b7b8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/sync/once.go:66 +0xee
Aug 30 14:33:46 Node1 metricbeat[106331]: sync.(*Once).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/sync/once.go:57
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).init(0xc000a1ba10)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/add_cloud_metadata.go:98 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.New
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/add_cloud_metadata.go:88 +0x2c6
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 130 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).getConn(0xc000588000, 0xc0007ea000, 0x0, 0xc0008899c0, 0x5, 0xc0007ec000, 0x13, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1350 +0x5ac
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).roundTrip(0xc000588000, 0xc0007e8200, 0x563c61cc2a40, 0x301, 0xc0007e8200)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:569 +0x7ce
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).RoundTrip(0xc000588000, 0xc0007e8200, 0xc000588000, 0xc1ac93f371357b57, 0xb919b804)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/roundtrip.go:17 +0x37
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.send(0xc0007e8100, 0x563c61df84c0, 0xc000588000, 0xc1ac93f371357b57, 0xb919b804, 0x563c63e0aee0, 0xc0006d0a98, 0xc1ac93f371357b57, 0x1, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:252 +0x453
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).send(0xc0007e0060, 0xc0007e8100, 0xc1ac93f371357b57, 0xb919b804, 0x563c63e0aee0, 0xc0006d0a98, 0x0, 0x1, 0xf8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:176 +0xff
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).do(0xc0007e0060, 0xc0007e8100, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:718 +0x45f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:586
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchRaw(0xc000a1b3e0, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0xc0008899c0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:101 +0x375
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchMetadata(0xc000a1b3e0, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:70 +0x1dc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata.func2(0x563c61e67980, 0xc0003ec300, 0xc000540060, 0x563c61df2be0, 0xc000a1b3e0, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:157 +0xb0
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:154 +0x3bc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 131 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).roundTrip(0xc000f88000, 0xc000e28000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2573 +0x7a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).roundTrip(0xc000588000, 0xc000e24200, 0x563c61cc2a40, 0x1, 0xc000e24200)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:582 +0xab8
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).RoundTrip(0xc000588000, 0xc000e24200, 0xc000588000, 0xc1ac93f37135fca5, 0xb91a3949)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/roundtrip.go:17 +0x37
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.send(0xc000e24100, 0x563c61df84c0, 0xc000588000, 0xc1ac93f37135fca5, 0xb91a3949, 0x563c63e0aee0, 0xc000e26008, 0xc1ac93f37135fca5, 0x1, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:252 +0x453
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).send(0xc0006fc060, 0xc000e24100, 0xc1ac93f37135fca5, 0xb91a3949, 0x563c63e0aee0, 0xc000e26008, 0x0, 0x1, 0xf8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:176 +0xff
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).do(0xc0006fc060, 0xc000e24100, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:718 +0x45f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:586
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchRaw(0xc000a1b500, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0xc0001ff590, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:101 +0x375
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchMetadata(0xc000a1b500, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:70 +0x1dc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata.func2(0x563c61e67980, 0xc0003ec300, 0xc000540060, 0x563c61df2be0, 0xc000a1b500, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:157 +0xb0
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:154 +0x3bc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 132 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).roundTrip(0xc000c28000, 0xc000c1e000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2573 +0x7a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).roundTrip(0xc000588000, 0xc000c12200, 0x563c61cc2a40, 0x301, 0xc000c12200)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:582 +0xab8
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).RoundTrip(0xc000588000, 0xc000c12200, 0xc000588000, 0xc1ac93f37134a133, 0xb918ddae)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/roundtrip.go:17 +0x37
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.send(0xc000c12100, 0x563c61df84c0, 0xc000588000, 0xc1ac93f37134a133, 0xb918ddae, 0x563c63e0aee0, 0xc000012250, 0xc1ac93f37134a133, 0x1, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:252 +0x453
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).send(0xc000826060, 0xc000c12100, 0xc1ac93f37134a133, 0xb918ddae, 0x563c63e0aee0, 0xc000012250, 0x0, 0x1, 0x7f50341be638)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:176 +0xff
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).do(0xc000826060, 0xc000c12100, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:718 +0x45f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:586
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchRaw(0xc000a1b650, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0xc000056550, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:101 +0x375
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchMetadata(0xc000a1b650, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:70 +0x1dc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata.func2(0x563c61e67980, 0xc0003ec300, 0xc000540060, 0x563c61df2be0, 0xc000a1b650, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:157 +0xb0
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:154 +0x3bc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 133 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).roundTrip(0xc000a38000, 0xc000a2c000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2573 +0x7a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).roundTrip(0xc000588000, 0xc000a28200, 0x563c61cc2a40, 0x1, 0xc000a28200)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:582 +0xab8
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).RoundTrip(0xc000588000, 0xc000a28200, 0xc000588000, 0xc1ac93f3713827df, 0xb91c6496)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/roundtrip.go:17 +0x37
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.send(0xc000a28100, 0x563c61df84c0, 0xc000588000, 0xc1ac93f3713827df, 0xb91c6496, 0x563c63e0aee0, 0xc000a2a008, 0xc1ac93f3713827df, 0x1, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:252 +0x453
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).send(0xc000a24060, 0xc000a28100, 0xc1ac93f3713827df, 0xb91c6496, 0x563c63e0aee0, 0xc000a2a008, 0x0, 0x1, 0xf8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:176 +0xff
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).do(0xc000a24060, 0xc000a28100, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:718 +0x45f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:586
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchRaw(0xc000a1b770, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0xc000889a80, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:101 +0x375
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchMetadata(0xc000a1b770, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:70 +0x1dc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata.func2(0x563c61e67980, 0xc0003ec300, 0xc000540060, 0x563c61df2be0, 0xc000a1b770, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:157 +0xb0
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:154 +0x3bc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 134 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).roundTrip(0xc00142e000, 0xc001420000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2573 +0x7a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).roundTrip(0xc000588000, 0xc001414200, 0x563c61cc2a40, 0x1, 0xc001414200)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:582 +0xab8
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).RoundTrip(0xc000588000, 0xc001414200, 0xc000588000, 0xc1ac93f371387f1b, 0xb91cbbb4)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/roundtrip.go:17 +0x37
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.send(0xc001414100, 0x563c61df84c0, 0xc000588000, 0xc1ac93f371387f1b, 0xb91cbbb4, 0x563c63e0aee0, 0xc001416008, 0xc1ac93f371387f1b, 0x1, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:252 +0x453
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).send(0xc001410060, 0xc001414100, 0xc1ac93f371387f1b, 0xb91cbbb4, 0x563c63e0aee0, 0xc001416008, 0x0, 0x1, 0xf8)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:176 +0xff
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).do(0xc001410060, 0xc001414100, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:718 +0x45f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:586
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchRaw(0xc000a1b890, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0xc0000565f0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:101 +0x375
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchMetadata(0xc000a1b890, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:70 +0x1dc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata.func2(0x563c61e67980, 0xc0003ec300, 0xc000540060, 0x563c61df2be0, 0xc000a1b890, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:157 +0xb0
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:154 +0x3bc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 135 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).roundTrip(0xc0005f6000, 0xc0005b8300, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2573 +0x7a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).roundTrip(0xc000588000, 0xc0005a0200, 0x563c61cc2a40, 0x7f503443b701, 0xc0005a0200)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:582 +0xab8
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Transport).RoundTrip(0xc000588000, 0xc0005a0200, 0xc000588000, 0xc1ac93f371340f75, 0xb9184c04)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/roundtrip.go:17 +0x37
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.send(0xc0005a0100, 0x563c61df84c0, 0xc000588000, 0xc1ac93f371340f75, 0xb9184c04, 0x563c63e0aee0, 0xc00062c030, 0xc1ac93f371340f75, 0x1, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:252 +0x453
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).send(0xc000592060, 0xc0005a0100, 0xc1ac93f371340f75, 0xb9184c04, 0x563c63e0aee0, 0xc00062c030, 0x0, 0x1, 0x7f503443b778)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:176 +0xff
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).do(0xc000592060, 0xc0005a0100, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:718 +0x45f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*Client).Do(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/client.go:586
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchRaw(0xc000a1b9e0, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0xc000056640, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:101 +0x375
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*httpMetadataFetcher).fetchMetadata(0xc000a1b9e0, 0x563c61e67980, 0xc0003ec300, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, 0xb2d05e00, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/http_fetcher.go:70 +0x1dc
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata.func2(0x563c61e67980, 0xc0003ec300, 0xc000540060, 0x563c61df2be0, 0xc000a1b9e0, 0x563c61df84c0, 0xc000588000, 0x0, 0x0, 0x0, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:157 +0xb0
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_cloud_metadata.(*addCloudMetadata).fetchMetadata
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_cloud_metadata/providers.go:154 +0x3bc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 116 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).readLoop(0xc0007dad80)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2167 +0x9ac
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1715 +0xcb7
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 117 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).writeLoop(0xc0007dad80)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2346 +0x11e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1716 +0xcdc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 178 [IO wait]:
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d5908, 0x72, 0x563c61dfc5e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc000f8a098, 0x72, 0x563c61dfc500, 0x563c63c023a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitRead(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).Read(0xc000f8a080, 0xc00083e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).Read(0xc000f8a080, 0xc00083e000, 0x1000, 0x1000, 0x90, 0x563c61b07840, 0x400)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_posix.go:55 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*conn).Read(0xc00083c000, 0xc00083e000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/net.go:182 +0x90
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).Read(0xc000f88000, 0xc00083e000, 0x1000, 0x1000, 0x563c5da35690, 0x60, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1894 +0x77
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).fill(0xc000344000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:101 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).Peek(0xc000344000, 0x1, 0xc000540360, 0x0, 0x563c63e42dc0, 0xc000247530, 0x563c5da3d990)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:139 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).readLoop(0xc000f88000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2047 +0x1aa
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1715 +0xcb7
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 94 [IO wait]:
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d5820, 0x72, 0x563c61dfc5e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc000172098, 0x72, 0x563c61dfc500, 0x563c63c023a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitRead(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).Read(0xc000172080, 0xc000c2c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).Read(0xc000172080, 0xc000c2c000, 0x1000, 0x1000, 0x90, 0x563c61b07840, 0x400)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_posix.go:55 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*conn).Read(0xc000012560, 0xc000c2c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/net.go:182 +0x90
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).Read(0xc0005f6000, 0xc000c2c000, 0x1000, 0x1000, 0x563c5da35690, 0x60, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1894 +0x77
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).fill(0xc0006d87e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:101 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).Peek(0xc0006d87e0, 0x1, 0xc000c222a0, 0x0, 0x563c63e42dc0, 0xc000249530, 0x563c5da3d990)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:139 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).readLoop(0xc0005f6000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2047 +0x1aa
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1715 +0xcb7
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 32 [IO wait]:
Aug 30 14:33:46 Node1 systemd[1]: metricbeat.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ An ExecStart= process belonging to unit metricbeat.service has exited.
░░
░░ The process’ exit code is ‘exited’ and its exit status is 2.
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d5738, 0x72, 0x563c61dfc5e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc000c2a098, 0x72, 0x563c61dfc500, 0x563c63c023a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitRead(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).Read(0xc000c2a080, 0xc000a40000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).Read(0xc000c2a080, 0xc000a40000, 0x1000, 0x1000, 0x90, 0x563c61b07840, 0x400)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_posix.go:55 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*conn).Read(0xc000a2a010, 0xc000a40000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/net.go:182 +0x90
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).Read(0xc000c28000, 0xc000a40000, 0x1000, 0x1000, 0x563c5da35690, 0x60, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1894 +0x77
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).fill(0xc000315440)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:101 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).Peek(0xc000315440, 0x1, 0xc000a302a0, 0x2, 0x563c63e42dc0, 0xc000247d30, 0x563c5da3d990)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:139 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).readLoop(0xc000c28000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2047 +0x1aa
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1715 +0xcb7
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 164 [IO wait]:
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d5650, 0x72, 0x563c61dfc5e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc000a3c098, 0x72, 0x563c61dfc500, 0x563c63c023a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitRead(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).Read(0xc000a3c080, 0xc001434000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).Read(0xc000a3c080, 0xc001434000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_posix.go:55 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*conn).Read(0xc001416018, 0xc001434000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 systemd[1]: metricbeat.service: Failed with result ‘exit-code’.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ The unit metricbeat.service has entered the ‘failed’ state with result ‘exit-code’.
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/net.go:182 +0x90
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).Read(0xc000a38000, 0xc001434000, 0x1000, 0x1000, 0x563c5da35690, 0x60, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1894 +0x77
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).fill(0xc000316480)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:101 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).Peek(0xc000316480, 0x1, 0xc0005403c0, 0x0, 0x0, 0xc000606530, 0x563c5da3d990)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:139 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).readLoop(0xc000a38000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2047 +0x1aa
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1715 +0xcb7
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 33 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).writeLoop(0xc000c28000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2346 +0x11e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1716 +0xcdc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 179 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).writeLoop(0xc000f88000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2346 +0x11e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1716 +0xcdc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 95 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).writeLoop(0xc0005f6000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2346 +0x11e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1716 +0xcdc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 148 [IO wait]:
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d5568, 0x72, 0x563c61dfc5e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc001432098, 0x72, 0x563c61dfc500, 0x563c63c023a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitRead(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).Read(0xc001432080, 0xc000f8c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).Read(0xc001432080, 0xc000f8c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_posix.go:55 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*conn).Read(0xc000e26018, 0xc000f8c000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/net.go:182 +0x90
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).Read(0xc00142e000, 0xc000f8c000, 0x1000, 0x1000, 0x563c5da35690, 0x60, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1894 +0x77
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).fill(0xc0000feb40)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:101 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).Peek(0xc0000feb40, 0x1, 0xc000540420, 0x0, 0x563c63e42dc0, 0xc000248d30, 0x563c5da3d990)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:139 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).readLoop(0xc00142e000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2047 +0x1aa
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1715 +0xcb7
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 165 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).writeLoop(0xc000a38000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2346 +0x11e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1716 +0xcdc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 149 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).writeLoop(0xc00142e000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2346 +0x11e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by net/http.(*Transport).dialConn
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1716 +0xcdc
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 166 [IO wait]:
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.runtime_pollWait(0x7f50357d5ad8, 0x72, 0x563c61dfc5e0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/runtime/netpoll.go:222 +0x65
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).wait(0xc0005e8e18, 0x72, 0x563c61dfc500, 0x563c63c023a0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:87 +0x47
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*pollDesc).waitRead(…)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_poll_runtime.go:92
Aug 30 14:33:46 Node1 metricbeat[106331]: internal/poll.(*FD).Read(0xc0005e8e00, 0xc000bb7000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/internal/poll/fd_unix.go:159 +0x1a5
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*netFD).Read(0xc0005e8e00, 0xc000bb7000, 0x1000, 0x1000, 0xc001414600, 0x28, 0xc00059e1b0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/fd_posix.go:55 +0x51
Aug 30 14:33:46 Node1 metricbeat[106331]: net.(*conn).Read(0xc00053cb90, 0xc000bb7000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/net.go:182 +0x90
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*persistConn).Read(0xc0007dad80, 0xc000bb7000, 0x1000, 0x1000, 0x563c5dd6105f, 0xc001414600, 0x563c61df84c0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:1894 +0x77
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).fill(0xc000903260)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:101 +0x105
Aug 30 14:33:46 Node1 metricbeat[106331]: bufio.(*Reader).ReadSlice(0xc000903260, 0x10a, 0x7f5038361fff, 0x400, 0x7f5038191e00, 0x20300000000000, 0x7f5038361fff)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/bufio/bufio.go:360 +0x3f
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http/internal.readChunkLine(0xc000903260, 0x7f5038361fff, 0xc000f09a78, 0x563c5da48ebf, 0x7f5038191d00, 0x20300000000000)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/internal/chunked.go:122 +0x36
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http/internal.(*chunkedReader).beginChunk(0xc000592210)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/internal/chunked.go:48 +0x34
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http/internal.(*chunkedReader).Read(0xc000592210, 0xc0005fa000, 0x200, 0x200, 0x7f5034392938, 0xc000f09b48, 0x563c5da3d48a)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/internal/chunked.go:93 +0x145
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*body).readLocked(0xc0005b8380, 0xc0005fa000, 0x200, 0x200, 0xc0005fa000, 0x7f5034392938, 0xc000f09b01)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transfer.go:833 +0x62
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*body).Read(0xc0005b8380, 0xc0005fa000, 0x200, 0x200, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transfer.go:825 +0xf9
Aug 30 14:33:46 Node1 metricbeat[106331]: net/http.(*bodyEOFSignal).Read(0xc0005b8600, 0xc0005fa000, 0x200, 0x200, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/net/http/transport.go:2727 +0xe2
Aug 30 14:33:46 Node1 metricbeat[106331]: encoding/json.(*Decoder).refill(0xc0004c6580, 0x88, 0x7f505eca7808)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/encoding/json/stream.go:165 +0xed
Aug 30 14:33:46 Node1 metricbeat[106331]: encoding/json.(*Decoder).readValue(0xc0004c6580, 0x0, 0x0, 0x563c61ad01a0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/encoding/json/stream.go:140 +0x1ff
Aug 30 14:33:46 Node1 metricbeat[106331]: encoding/json.(*Decoder).Decode(0xc0004c6580, 0x563c61253080, 0xc00059e240, 0x563c61df84e0, 0xc0005b8600)
Aug 30 14:33:46 Node1 metricbeat[106331]: /usr/local/go/src/encoding/json/stream.go:63 +0x7b
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/docker/docker/client.(*Client).Events.func1(0xc000316de0, 0xc0005e8d00, 0xc001422f40, 0x1e, 0x0, 0x0, 0xc0014116b0, 0xc0014244e0, 0x563c61e67900, 0xc001420580, …)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/docker/engine@v0.0.0-20191113042239-ea84732a7725/client/events.go:53 +0x365
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/docker/docker/client.(*Client).Events
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/pkg/mod/github.com/docker/engine@v0.0.0-20191113042239-ea84732a7725/client/events.go:25 +0x119
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 195 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common/docker.(*watcher).watch.func1(0x563c63e41600)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/docker/watcher.go:276 +0x445
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common/docker.(*watcher).watch(0xc0014440a0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/docker/watcher.go:319 +0x214
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/common/docker.(*watcher).Start
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/docker/watcher.go:238 +0x305
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 196 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/common/docker.(*watcher).cleanupWorker(0xc0014440a0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/docker/watcher.go:426 +0x125
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/common/docker.(*watcher).Start
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/common/docker/watcher.go:239 +0x32a
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 200 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/processors/add_kubernetes_metadata.(*cache).cleanup(0xc00089ab70)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_kubernetes_metadata/cache.go:79 +0x235
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/processors/add_kubernetes_metadata.newCache
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/processors/add_kubernetes_metadata/cache.go:44 +0xc6
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 204 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.(*bufferingEventLoop).run(0xc0008b3220)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/eventloop.go:316 +0x1d1
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.NewQueue.func1(0xc0005822a0, 0x563c61e20100, 0xc0008b3220)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:176 +0x62
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.NewQueue
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:174 +0x3ce
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 205 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.(*ackLoop).run(0xc0008ccbe0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/ackloop.go:60 +0x118
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.NewQueue.func2(0xc0005822a0, 0xc0008ccbe0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:180 +0x5b
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.NewQueue
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/broker.go:178 +0x405
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 206 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/queue/memqueue.(*consumer).Get(0xc000897880, 0x32, 0x0, 0x0, 0x0, 0x0)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/queue/memqueue/consume.go:65 +0xf1
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*eventConsumer).loop(0xc00037e5a0, 0x563c61e20140, 0xc000897880)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:182 +0x1a2
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.newEventConsumer.func1(0xc00037e5a0, 0x563c61e20140, 0xc000897860)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:86 +0x6e
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.newEventConsumer
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/consumer.go:84 +0x153
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 207 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*retryer).loop(0xc00037e780)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/retry.go:135 +0x255
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.newRetryer
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/retry.go:94 +0x15d
Aug 30 14:33:46 Node1 metricbeat[106331]: goroutine 208 [select]:
Aug 30 14:33:46 Node1 metricbeat[106331]: github.com/elastic/beats/v7/libbeat/publisher/pipeline.(*netClientWorker).run(0xc00037e960)
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/output.go:127 +0xcb
Aug 30 14:33:46 Node1 metricbeat[106331]: created by github.com/elastic/beats/v7/libbeat/publisher/pipeline.makeClientWorker
Aug 30 14:33:46 Node1 metricbeat[106331]: /go/src/github.com/elastic/beats/libbeat/publisher/pipeline/output.go:79 +0x196
Aug 30 14:33:46 Node1 metricbeat[106331]: rax 0x0
Aug 30 14:33:46 Node1 metricbeat[106331]: rbx 0x7f4ff3fff640
Aug 30 14:33:46 Node1 metricbeat[106331]: rcx 0x7f505ed6c9fc
Aug 30 14:33:46 Node1 metricbeat[106331]: rdx 0x6
Aug 30 14:33:46 Node1 metricbeat[106331]: rdi 0x19f5b
Aug 30 14:33:46 Node1 metricbeat[106331]: rsi 0x19f6a
Aug 30 14:33:46 Node1 metricbeat[106331]: rbp 0x19f6a
Aug 30 14:33:46 Node1 metricbeat[106331]: rsp 0x7f4ff3ffe7a0
Aug 30 14:33:46 Node1 metricbeat[106331]: r8 0x7f4ff3ffe870
Aug 30 14:33:46 Node1 metricbeat[106331]: r9 0x7fffffff
Aug 30 14:33:46 Node1 metricbeat[106331]: r10 0x8
Aug 30 14:33:46 Node1 metricbeat[106331]: r11 0x246
Aug 30 14:33:46 Node1 metricbeat[106331]: r12 0x6
Aug 30 14:33:46 Node1 metricbeat[106331]: r13 0x16
Aug 30 14:33:46 Node1 metricbeat[106331]: r14 0x563c60d09d54
Aug 30 14:33:46 Node1 metricbeat[106331]: r15 0x0
Aug 30 14:33:46 Node1 metricbeat[106331]: rip 0x7f505ed6c9fc
Aug 30 14:33:46 Node1 metricbeat[106331]: rflags 0x246
Aug 30 14:33:46 Node1 metricbeat[106331]: cs 0x33
Aug 30 14:33:46 Node1 metricbeat[106331]: fs 0x0
Aug 30 14:33:46 Node1 metricbeat[106331]: gs 0x0
Aug 30 14:33:47 Node1 systemd[1]: metricbeat.service: Scheduled restart job, restart counter is at 5.
░░ Subject: Automatic restarting of a unit has been scheduled
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ Automatic restarting of the unit metricbeat.service has been scheduled, as the result for
░░ the configured Restart= setting for the unit.
Aug 30 14:33:47 Node1 systemd[1]: Stopped Metricbeat is a lightweight shipper for metrics..
░░ Subject: A stop job for unit metricbeat.service has finished
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ A stop job for unit metricbeat.service has finished.
░░
░░ The job identifier is 68961 and the job result is done.
Aug 30 14:33:47 Node1 systemd[1]: metricbeat.service: Start request repeated too quickly.
Aug 30 14:33:47 Node1 systemd[1]: metricbeat.service: Failed with result ‘exit-code’.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ The unit metricbeat.service has entered the ‘failed’ state with result ‘exit-code’.
Aug 30 14:33:47 Node1 systemd[1]: Failed to start Metricbeat is a lightweight shipper for metrics..
░░ Subject: A start job for unit metricbeat.service has failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ A start job for unit metricbeat.service has finished with a failure.
░░
░░ The job identifier is 68961 and the job result is failed.
August 30, 2024 at 12:17 pm #7494
Yongwook Song
Participant
Thank you for the details. I think it is maybe due to the seccomp policy based on Google search.

https://discuss.elastic.co/t/metricbeat-service-get-stopped-after-service-start/336567/2

https://github.com/elastic/apm-server/issues/6238

I would recommend to follow one of answers in the second link above.

I think you can add “seccomp.enabled: false” on the metricbeat.yml file first to check if seccomp policy is the issue or not.

Here is metricbeat.yml reference example that shows the seccomp option as well. https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-reference-yml.html

Please let me know if this fixes it or not.

Thanks,

-Song
September 1, 2024 at 2:57 pm #7495
Prateek Jain
Participant
A quick update on the issue.. All the default three beats (packetbeat, metricbeat and filebeat) were causing some issue with all my VMs. All the three services were failing to restart for different reasons. I updated all the three beats following the instructions on the elasticsearch website and it resolved the issue.

https://www.elastic.co/guide/en/beats/packetbeat/8.15/setup-repositories.html#_apt

I am not sure but maybe the installation of these beats that occurs with configuring the measurement framework in mf = MFLib(slice_name, "/tmp/mflib") step needs to be updated to use the latest version of the beats.
September 3, 2024 at 1:23 pm #7510
Yongwook Song
Participant
Thank you for the update Prateek. Yes, we will look into this for solution in next version.
Author

Posts

Viewing 10 posts - 1 through 10 (of 10 total)

You must be logged in to reply to this topic.