Skip to content
Snippets Groups Projects
Commit ca1a5be9 authored by Ed's avatar Ed Committed by Tom Wilkie
Browse files

Adding metric and alert to notify promtail falling behind (#412)

* Adding the metric promtail_file_bytes_total which will report on the total size of each file with an active tailer.
Added an alert which will fire whenever the total bytes for a file is 100kb or more ahead the read bytes for more than 15mins.
Added an additional alert to track client bytes ready to send (encoded bytes) vs actually sent so we can add an alert on promtail send failures and still track stats on encoded bytes being sent.

* Moving where we update the total file bytes outside the tailer so it shouldn't get hung up by tailer issues.

* Recording file size based on Glob matches rather than what we are tailing to give even better insight
parent 55bad57e
No related branches found
No related tags found
No related merge requests found
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment