1. Prometheus/Grafana/Node Exporter example not working?

Prometheus/Grafana/Node Exporter example not working?

Home Forums FABRIC General Questions and Discussion Prometheus/Grafana/Node Exporter example not working?

Viewing 9 posts - 1 through 9 (of 9 total)
  • Author
    Posts
  • #8525
    PHILIP CUMMINS
    Participant

      Hello,
      I am following the Prometheus/Grafana/Node Exporter example, I can SSH into the box using my slice key and ssh config. I cannot see any metrics in the Node Exporter Full default dashboard, I cannot see the MySlice data source.

      Please can you help me by suggesting some debug steps? I have not set up these tools before.

      I see prometheus.yml being generated as I expect:

      global:
        scrape_interval: 1m
      scrape_configs:
      - job_name: prometheus
        scrape_interval: 1m
        static_configs:
        - targets:
          - localhost:9090
      - job_name: MySlice
        static_configs:
        - targets:
          - 10.144.10.2:9100
          - 10.143.10.2:9100

      Also some more comments on the examples would be very useful, for example, I don’t know why this is required, and why it is only required in one of the devices: iface1 = node1.add_component(model=’NIC_Basic’, name=’nic1′).get_interfaces()[0]

      #8527
      Charles Carpenter
      Participant

        I can look into this for you. Can you tell me exactly which example you are following? ie jupyter-examples-rel1.8.0 and file name or from the Archive Manager?

         

         

        #8529
        PHILIP CUMMINS
        Participant

          i am following:
          jupyter-examples-rel1.8.0/fabric_examples/complex_recipes/grafana_prometheus_servers

          I have the two slices open: GrafanaServer and MySlice.

          the prometheus.yml looks as expected but i don’t see the data source.

          as i am in EU, i probably won’t have the SSH tunnel open when you check.

          Thanks,

          Phil

          #8530
          PHILIP CUMMINS
          Participant

            MySlice ID: 8b22983e-2165-483e-a37b-7c75df1b5804

            GrafanaServer ID: c2ef6dc8-c05f-4d14-be93-f86457e59016

            #8539
            Komal Thareja
            Participant

              Sorry, wrong post!

              #8542
              PHILIP CUMMINS
              Participant

                I forgot to extend the slice, sorry.

                are you able to follow the example?
                jupyter-examples-rel1.8.0/fabric_examples/complex_recipes/grafana_prometheus_servers

                #8560
                PHILIP CUMMINS
                Participant

                  hi Charles, were you able to complete the grafana/node exporter example?

                  I can’t see how this can be an issue with the prometheus configuration

                  #8561
                  Charles Carpenter
                  Participant

                    I was unable to get the notebook to run correctly.  It looks like this is an older notebook that needs updating.  There is a problem with Grafana’s provisioning of the data source and dashboards that needs to be fixed. As a test fix, you could change the user: “472” in the monitoring docker compose to user: root   This will allow the Grafana provisioning to add the data source and the dashboards. However, in my experiment the connections to the nodes are being blocked for port 9100.

                    #8565
                    Charles Carpenter
                    Participant

                      Please note that running docker container as root is a security risk and should not be normally done. I was suggesting it for debugging purposes only.

                    Viewing 9 posts - 1 through 9 (of 9 total)
                    • You must be logged in to reply to this topic.