* update cortex to latest master

using v3.4.0-rc.1 for go.etcd.io/etcd
v0.0.2 for github.com/prometheus/procfs
v1.0.0 for github.com/prometheus/client_golang
latest master for github.com/weaveworks/common with changes from https://github.com/weaveworks/common/pull/153

* fixed failing tests

* use large instance for test and lint jobs in CircleCI

* running only 6 test binaries in parallel

* removed resource type change for CircleCI

* changed GOGC to 10 for lint makefile target

* replace gzip golang package by github.com/klauspost/compress

* cleanup import

* revert grafana tag image

* Use prometheus pool for line buffer.

* add benchmark for storage queries
* improve iterator to load only on next
* fix memory retained by lazy chunks
* reverse backward lazy iterator

Support for reading systemd journal entries has been added. 
promtail will look for a job in scrape_configs with a journal key 
to activate the journal target. 

If GOOS=linux and CGO_ENABLED=1, promtail will now require 
libsystemd headers to be available for building. If GOOS is not 
linux or CGO_ENABLED is not 1, journal support will be unavailable
and a log message will be printed warning the user that their config 
file has journal tailing configured without it being built into promtail. 

See docs/promtail-examples.md for a concrete example of 
using journal support. 

Other structural changes made: 

  1. Ability for checking if scrape.Config.ServiceDiscoveryConfig is 
     non-zero has been added. 

     This was chosen over making ServiceDiscoveryConfig a pointer
     as yaml.v2 cannot parse an inline struct into a pointer value. 

  2. Updated pipeline logger component name to journal_pipeline and
     file_pipeline for JournalTargetManager and FileTargetManager
     respectively.

  3. The positions file will now store positions as strings instead of 
     integers. Existing positions will be read in properly but written out 
     as strings the next time the positions file is saved. This is done to 
     be able to store the journal cursor, which is a string. The positions 
     API has been updated to support reading in the old integer values 
     and the new string values. 

* Query label values and names are now fetched from the store.

A time range is now required by the /api/prom/label with a sane default (6 hours from now).

* fix http querystring and update doc

* update vendor

* rebased

* adds first version of docker driver

* without logrus and fixes some linter issue

* fix the driver and start a build system

* adds swarm label discovery

* Add documentation and more targets

* make the linter happy ❤️

* indent config.json

* with circleci steps for master and branch

* Review Feebacks

* fix(promtail/targets): remove dependency on prometheus/relabel

`filetargetmanager.go` had a dependency on prometheus/relabel, a package that
has been removed in favor of prometheus/pkg/relabel.
This converts the code to the new package, to allow the prometheus vendor be
updated to master

* chore(vendor): update prometheus vendor

Updates prometheus vendor to current master, to add support for InitContainers
in kubernetes service discovery

* chore(vendor): do dep's homework

Gives dep hints on how to resolve the vendor so that it work

* fix(promtail/targets): non-nil check

Accidentally checked against the wrong labelSet, this one can never get nil

Updates cortex vendor to get the changes from cortexproject/cortex#1431.
Required for making promtail build on Windows

Signed-off-by: sh0rez <me@shorez.de>

* Update cortex vendor
Use query max look back from cortex
Update config changes from cortex
Fixed breaking code due to updating cortex vendor

* fixed linter error

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* vendor: update cortex

Don't be blocked on https://github.com/cortexproject/cortex/pull/1345

 to
be merged and still maintain the fork

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* add memcached ksonnet

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* commit generated proto

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* add a custom server for loki with assets embedded

* adds a targets page for promtail to see discovered files and labels

* lint fixes

* fix css table size

* add service discovery logic

* add service discovery template

* add promtail pages documentation

* ignored gen file in linter

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Lazy load chunks for queries.

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Add context to the lazy chunk calls

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Make sure labels are plumbed through

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Pre-load non-overlapping chunk iterators

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Review feedback

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

Changes to the library move the handling of symlinks and re-opening to the tail library.
fsnotify events are only used now to start new tailers for files not previously seen.

* Move live log tailing behind websocket on server

Live log tailing now requires client to just open a websocket and keep listening to it for getting live logs for matching query

* Fixed linting errors

* Unexported tailQuery querier method

* Added a delay in querying of logs to not miss delayed entries

* Renamed variable for better readability

* Some code refactoring suggested in PR review

* Fixed linter errors

* Code refactoring requested in PR review

* Disabling linting for writeHTTPErrorResponse since same value for an input is being passed from all function calls for now

* Removed a function which already existed

* Improved printing of log entries using cli and some other code refactoring

* Checking no-labels flag before printing log stream while tailing

* Add tracing to loki

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Use the op names from common/server

We don't need to the tracing middleware again. Further, the op names are
not sanitised here.

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Update cortex vendoring

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* Fix API breakage

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

adding third party lib for Glob pattern matching which supports /**/ style subdirectory matching (#331)

* adding third party lib for Glob pattern matching which supports **
refactor promtail_test to be easier to read and include more tests

* Update cortex to include optionally-enforce-metric-name

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Configure validation to allow 'metrics' without metric names.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* all: update dependencies

* Update some more dependancies and pin the right versions for Prometheus deps.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* WIP: Persistence config

Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>

* properly update vendor.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Persistence chunks using the Cortex chunk store.

Fixes #37.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Fallback to lo0 if we can't find a interface to advertise.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* s/lo0/lo/

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Make promtail read all its config from a file.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Use gokit logging everywhere.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Start work to parse normal log lines.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* update common and kuberesolver.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* lint

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Get EntryParser stuff working, so we can tail raw log files.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* Make sure filename label works.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

* lint, remove interfacer.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>