Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

This allows easier integration of other targets than files for promtail.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

tail all container log files

kubelet creates a new log file when a container is restarted.
So we need to catpure all log files in the
`/var/logs/pods/<uid>/<container_name>/` dir.

* handle symbolic links correctly

When tailing a file that is rotated we expect that a fsnotify.Rename
event will be sent when the old file is renamed and a fsnotif.Create
event will be sent when the replacement file is created. This allows
us to close and re-open the file.  However if the file we are
tailing is a symbolic link (and the target is in another directory)
we wont get these events.  To address this we need to tail the target
file directly.

fixes #274

* handle symlinks being re-linked

When a symbolic link is re-linked we will only get a fsnotify.Create
event. No rename or delete event will have been sent to trigger
the tailer to be stoped.  When this happens we should stop the current
tailer for the path and start a new one. This will allow us to perform
a new Readink on the path to get the updated target filename.

* Flush idle chunks properly

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Review feedback

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Review feedback.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Check the correct chunk is full before appending a new chunk.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Add the config to helm and ksonnet too.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Clarify links to other sections

* Expanded setup sections

* Clarified usage docs

* Extracted contributing.md

* Extracted provisioning.md

* Operations docs

* Troubleshooting docs started

* Review feedback.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Update cortex to include optionally-enforce-metric-name

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Configure validation to allow 'metrics' without metric names.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Also, make ErrOutOfOrder a HTTP 4xx error and continue to append even when we encourter an out of order entry.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

removing incorrect calling of positions.Stop from within a target as it runs single instance within promtail, moved the call to Stop up to promtail.go within the Shutdown() method.  Should Fix #249 (#252)

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Fix the mixin to reference the mixin-utils pkg.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* s/g.selector/utils.selector/

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Actually import utils.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Don't cut corners with replacing.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

__path__ is now expected to be a `glob` match, not a directory.  In k8s the "glob" expression needed is just the exact file path of the container log, which is `/var/log/pods/<podUID>/<container_name>/0.log`

* Adding a test for target.go
Fixing some shutdown issues where tailers were stopped but didn't properly wait for the current position to be saved to file
Fixed an issue where an empty directory would lead to nothing being tailed

* adding more tests for target.go

* renaming quitComplete -> done per feedback
making PositionsFile private again, no reason for it to be public
removed unnecessary save of empty file on creation of positions file

* fixing lint errors

* cleaning up some comments
removing TODO around directories, added a test to verify behavior
some more cleanup per review

* fixing imports

fix container_name label

add external_labels support to promtail ksonnet

add container_name label to logs

fixes #190
Pods can have multiple containers. This fix ensures that we collect
logs for all containers.

* allow promtail target path to be a glob match

Promtail now expects __path__ to be a glob. All files that match
the glob expression will be tailed.  If new files are created that
match the glob, they will immediately be tailed.

* remove entry from positions file when file is deleted

* fix syncing the current positions to positions file

* handle file renames

When a file is renamed a "rename" and a "create" event are sent.
We need to treat the rename as a remove.  If the new filename matches
the path glob, then we will start tailing it when the "create" event
is reveived.

* lint

Signed-off-by: Xiang Dai <764524258@qq.com>

* add beginnings of fluentd plugin

* working fluentd output plugin for loki

* refactor fluentd plugin

- update the plugin to support extra_labels, label_keys, line_format
  and drop_single_key options
- update rspec tests
- update readme
- build custom docker image for docker-compose
- default to systemd input by default.

* update readme todo section

* remove extra license file

Signed-off-by: Xiang Dai <764524258@qq.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>