Prometheus/Grafana/Node Exporter example not working?

[PHILIP CUMMINS]

Hello,
I am following the Prometheus/Grafana/Node Exporter example, I can SSH into the box using my slice key and ssh config. I cannot see any metrics in the Node Exporter Full default dashboard, I cannot see the MySlice data source.

Please can you help me by suggesting some debug steps? I have not set up these tools before.

I see prometheus.yml being generated as I expect:

global:
  scrape_interval: 1m
scrape_configs:
- job_name: prometheus
  scrape_interval: 1m
  static_configs:
  - targets:
    - localhost:9090
- job_name: MySlice
  static_configs:
  - targets:
    - 10.144.10.2:9100
    - 10.143.10.2:9100

Also some more comments on the examples would be very useful, for example, I don’t know why this is required, and why it is only required in one of the devices: iface1 = node1.add_component(model=’NIC_Basic’, name=’nic1′).get_interfaces()[0]

[Charles Carpenter]

I can look into this for you. Can you tell me exactly which example you are following? ie jupyter-examples-rel1.8.0 and file name or from the Archive Manager?

 

 

[PHILIP CUMMINS]

i am following:
jupyter-examples-rel1.8.0/fabric_examples/complex_recipes/grafana_prometheus_servers

I have the two slices open: GrafanaServer and MySlice.

the prometheus.yml looks as expected but i don’t see the data source.

as i am in EU, i probably won’t have the SSH tunnel open when you check.

Thanks,

Phil

[PHILIP CUMMINS]

MySlice ID: 8b22983e-2165-483e-a37b-7c75df1b5804

GrafanaServer ID: c2ef6dc8-c05f-4d14-be93-f86457e59016

[Komal Thareja]

Sorry, wrong post!

• This reply was modified 3 weeks, 6 days ago by Komal Thareja.

[PHILIP CUMMINS]

I forgot to extend the slice, sorry.

are you able to follow the example?
jupyter-examples-rel1.8.0/fabric_examples/complex_recipes/grafana_prometheus_servers

[PHILIP CUMMINS]

hi Charles, were you able to complete the grafana/node exporter example?

I can’t see how this can be an issue with the prometheus configuration

[Charles Carpenter]

I was unable to get the notebook to run correctly.  It looks like this is an older notebook that needs updating.  There is a problem with Grafana’s provisioning of the data source and dashboards that needs to be fixed. As a test fix, you could change the user: “472” in the monitoring docker compose to user: root   This will allow the Grafana provisioning to add the data source and the dashboards. However, in my experiment the connections to the nodes are being blocked for port 9100.

[Charles Carpenter]

Please note that running docker container as root is a security risk and should not be normally done. I was suggesting it for debugging purposes only.

[PHILIP CUMMINS]

yes it works after making the changes you suggested

[PHILIP CUMMINS]

ok i will close this now, thanks for the help

[Author]

Posts