using the timestamp from the log file might lead to undesired behavior as it could be way in the past or future depending on the clock for the source system generating the logs.  Given that it's compared to the servers time.Now() when looking for idle chunks it's probably best to use the server time when setting the value.

improve locking of positions

Signed-off-by: Steven Sheehy <ssheehy@firescope.com>

* support config chunk size

Signed-off-by: Xiang Dai <764524258@qq.com>

* fix lint

Signed-off-by: Xiang Dai <764524258@qq.com>

* review feedback

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Lazy load chunks for queries.

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Add context to the lazy chunk calls

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Make sure labels are plumbed through

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Pre-load non-overlapping chunk iterators

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Review feedback

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

Changes to the library move the handling of symlinks and re-opening to the tail library.
fsnotify events are only used now to start new tailers for files not previously seen.

* Move live log tailing behind websocket on server

Live log tailing now requires client to just open a websocket and keep listening to it for getting live logs for matching query

* Fixed linting errors

* Unexported tailQuery querier method

* Added a delay in querying of logs to not miss delayed entries

* Renamed variable for better readability

* Some code refactoring suggested in PR review

* Fixed linter errors

* Code refactoring requested in PR review

* Disabling linting for writeHTTPErrorResponse since same value for an input is being passed from all function calls for now

* Removed a function which already existed

* Improved printing of log entries using cli and some other code refactoring

* Checking no-labels flag before printing log stream while tailing

Signed-off-by: Steven Sheehy <ssheehy@firescope.com>

Remove useless func

No one called this func, keep it only mislead.

Signed-off-by: Xiang Dai <764524258@qq.com>

TestClient used for watching log file events appends logs to a list
Due to race condition some of the logs added to it goes missing
Adding a Mutex to it to lock messages before adding logs to it

Fixing lagging alert to also catch when the read_bytes is past the end of the file.
Adding an alert to let us know if we are missing tailing of any files.

Change hpcloud tailer library to poll mode to workaround bugs in the event driven code within the library
Had to rework tests with some waits for messages because polling is slower
There are several longer sleeps in the promtail_test which are not ideal and have been marked with FIXME to remove once we have a better solution

Signed-off-by: Xiang Dai <764524258@qq.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Adding the metric promtail_file_bytes_total which will report on the total size of each file with an active tailer.
Added an alert which will fire whenever the total bytes for a file is 100kb or more ahead the read bytes for more than 15mins.
Added an additional alert to track client bytes ready to send (encoded bytes) vs actually sent so we can add an alert on promtail send failures and still track stats on encoded bytes being sent.

* Moving where we update the total file bytes outside the tailer so it shouldn't get hung up by tailer issues.

* Recording file size based on Glob matches rather than what we are tailing to give even better insight

* Add tracing to loki

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Use the op names from common/server

We don't need to the tracing middleware again. Further, the op names are
not sanitised here.

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Update cortex vendoring

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Fix API breakage

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

fixed one bug which was probably unrelated to the test failure and broke out the test to avoid some non-deterministic behaviors in querying the ingester

Signed-off-by: Steven Sheehy <ssheehy@firescope.com>

* adding a few more test cases for entry parsing docker format

* adding testify assert and require to clean up tests

* some tweaking to improve readability

Adding a configurable timeout for calls to the loki server.
Updating promtail test to set sane defaults for all configurations and then override for testing.
Removing .idea folder from .gitignore, we should encourage people (and myself) to use global ignore for IDE configs

Signed-off-by: Steven Sheehy <ssheehy@firescope.com>

Signed-off-by: Steven Sheehy <ssheehy@firescope.com>

Signed-off-by: Steven Sheehy <ssheehy@firescope.com>

Signed-off-by: Steven Sheehy <ssheehy@firescope.com>

Signed-off-by: kun <oiooj@qq.com>

Signed-off-by: Xiang Dai <764524258@qq.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

adding third party lib for Glob pattern matching which supports /**/ style subdirectory matching (#331)

* adding third party lib for Glob pattern matching which supports **
refactor promtail_test to be easier to read and include more tests

* Adding a sync() function to filetarget which runs on a timer to catch any events missed by fsnotify

* moving where we mark the final position to avoid a race condition exposed in testing, we want to stop the tailer before shutting down our tailer loop

* Fix changes from PR and refactor to remove circular imports and make config consistent

* Adding an "integration" type unit test which tests promtail as a whole

* fixing a bunch of imports I munged
moved tailer to its own file
refactoring filetarget to make synclogic easier to follow and reused as much as possible