admin管理员组

文章数量:1404924

Live data works fine (Querier responds within seconds). Historical data queries (past days/weeks) cause Thanos Receive to hang, leading to slow/no response in Grafana. The system does not recover until I restart Thanos Receive.

    cat /etc/systemd/system/thanos-store.service
    [Unit]
    Description=Thanos Store Gateway
    After=network.target
    
    [Service]
    User=thanos
    Group=thanos
    ExecStart=/opt/thanos/thanos store --data-dir=/opt/thanos/data --objstore.config- 
    file=/etc/thanos/store.yml --grpc-address=0.0.0.0:10911 --http- 
    address=0.0.0.0:10912
    Restart=always
    
    [Install]
    WantedBy=multi-user.target
    


    cat /etc/systemd/system/thanos-receive.service
    [Unit]
    Description=Thanos Receive Service
    After=network.target
    
    [Service]
    User=thanos
    Group=thanos
    ExecStart=/opt/thanos/thanos receive \
      --receive.local-endpoint=192.168.1.80:10908 \
      --grpc-address=0.0.0.0:10907 \
      --http-address=0.0.0.0:10909 \
      --remote-write.address=0.0.0.0:10908 \
      --tsdb.path="/var/lib/thanos/receive" \
      --tsdb.retention=7d \
      --receive.hashrings='[{"endpoints":["192.168.1.80:10908"]}]' \
      --label "receive_cluster=\"thanos-receive\"" \
      --label "receive_replica=\"receive-1\"" \
      --objstore.config-file=/etc/thanos/store.yml
    Restart=always
    RestartSec=5
    LimitNOFILE=65536
    
    [Install]
    WantedBy=multi-user.target
    
    
    


    cat /etc/systemd/system/thanos-querier.service
    [Unit]
    Description=Thanos Querier
    After=network.target
    
    [Service]
    User=thanos
    Group=thanos
    ExecStart=/opt/thanos/thanos query --http-address=0.0.0.0:39091 --grpc- 
    address=0.0.0.0:39090 --store=192.168.1.80:10907 --store=192.168.1.80:10911 -- 
    query.auto-downsampling --query.replica-label=receive_replica --query.timeout=2m -- 
    query.max-concurrent=50 --query.partial-response --query.default-evaluation- 
    interval=30s
    
    Restart=always
    RestartSec=5
    LimitNOFILE=65536
    
    [Install]
    WantedBy=multi-user.target

Am facing issue here this is my setup using rhel not a container or kubernates setup, when i am quering using thanos querier i can fetch data within seconds but when i use Grafana as frontend for dashboarding, using thanos querier as datasouce it gives immediate data but when i want historical data it hangs the receiver if someone advice me on this how to proceed or changing some settings.

本文标签: prometheusThanos Querier Slow for Historical Data in Grafana (NonContainer RHEL Setup)Stack Overflow