* chore(ci/cd): breaking the circle

As the trial period for drone.io went really well (not a single failed build,
apart from merge-failures), I think it is time to make the switch to the new,
native ARM and much more performant platform.

This should fix all kinds of issues and be a solid architecture for the future
to level up our CI/CD in terms of performance and reliability.

* chore(packaging): drone.io check stage

Adds a check stage to the drone pipeline to lint and test

Simplifies tagging by removing conditionals and always publishing as `latest`
and for images also `master` on all builds (including tags).

Also fixes the tagging of the docker-driver, latest tag is back!

Builds the loki server binary for windows as well

Signed-off-by: Xiang Dai <764524258@qq.com>

* update cortex to latest master

using v3.4.0-rc.1 for go.etcd.io/etcd
v0.0.2 for github.com/prometheus/procfs
v1.0.0 for github.com/prometheus/client_golang
latest master for github.com/weaveworks/common with changes from https://github.com/weaveworks/common/pull/153

* fixed failing tests

* use large instance for test and lint jobs in CircleCI

* running only 6 test binaries in parallel

* removed resource type change for CircleCI

* changed GOGC to 10 for lint makefile target

brrrrrrr

Because drone.io provides us with native ARM runners, we evaluate the platform to figure out if it is a suitable replacement for CircleCI and qemu.

Configuration is done using .drone/drone.jsonnet, the .drone/drone.yml is generated from that.
Images are built on amd64, arm64 and arm, natively and without emulation. This allows to get rid of cross-compilation, which in turn allows more advanced builds (CGO, etc.)

Hopefully this will make the CI faster and more reliable in the future. Let's see!

This commit introduces a stopgap to get ARM builds working by
temporarily disabling journal reading support on ARM platforms.

This commit modifies the Makefile to build promtail with CGO_ENABLED if
both GOHOSTOS and GOOS are set to linux.

To facilitate the Docker container utilizing the journal support,
the container for promtail had to be modified to be based on top of
debian. The sd-journal library depends on libsystemd.so being present
at runtime. As alpine currently does not have a package for systemd,
the easiest approach is to change the base image to debian:stretch-slim.
A future solution for providing an alpine-based build will be considered
in the future and discussion for the approach will be tracked in #838.

This commit also updates the Dockerfile to default to using the
latest loki-build-image. If a specific version is required, it should
be provided as a build arg to docker build.

This PR sets up an automated release pipeline to cross compile build artifacts and publish them to github. mitchellh/gox is used for building, ghr for publishing

* Tool for creating and managing periodic tables stored in Bigtable

It has 2 commands:
1. backup-active-periodic-table: For backing up active periodic table
2. ensure-backups: It helps ensure right tables are backed up and retain only single backup for non active periodic tables

* Primarily this stop deletion of the generated file on a `make clean` which keeps the working directory diff free
* The generated file now checks all the input files to see if there are changes to determine if the target needs to be run
* Updated check-generated-files to include the promtail generated ui file

- bump build image to 0.4.0
- re-gen protos
- re-add deploy task

This finally adds support for multiple architectures!  

Images are now built using BuildKit (actually img), Dockerfiles were parameterized to allow this.
Containers are still built on alpine, using QEMU and binfmt as a kernel compatibility layer to allow RUN steps in these.

CircleCI has been fully revamped, to speed up builds and de-duplicate the configuration.
Makefile has been extended with additional logic to shadow the multi-arch to non-CI users.

Happy hacking on Raspberry Pi and friends :)

refactor(makefile): simplify makefile by removing the autogenerated targets and make building binaries and dockerfiles separate operations.

* add benchmark for storage queries
* improve iterator to load only on next
* fix memory retained by lazy chunks
* reverse backward lazy iterator

This commit rolls back the changes to the Makefile and build/Dockerfile
that caused CGO_ENABLED=1 to be present during some builds. This commit
causes the journal support to be disabled in any build produced by make.

Journal support can still be enabled in a manual build:

  go build -o cmd/promtail/promtail cmd/promtail

Support for reading systemd journal entries has been added. 
promtail will look for a job in scrape_configs with a journal key 
to activate the journal target. 

If GOOS=linux and CGO_ENABLED=1, promtail will now require 
libsystemd headers to be available for building. If GOOS is not 
linux or CGO_ENABLED is not 1, journal support will be unavailable
and a log message will be printed warning the user that their config 
file has journal tailing configured without it being built into promtail. 

See docs/promtail-examples.md for a concrete example of 
using journal support. 

Other structural changes made: 

  1. Ability for checking if scrape.Config.ServiceDiscoveryConfig is 
     non-zero has been added. 

     This was chosen over making ServiceDiscoveryConfig a pointer
     as yaml.v2 cannot parse an inline struct into a pointer value. 

  2. Updated pipeline logger component name to journal_pipeline and
     file_pipeline for JournalTargetManager and FileTargetManager
     respectively.

  3. The positions file will now store positions as strings instead of 
     integers. Existing positions will be read in properly but written out 
     as strings the next time the positions file is saved. This is done to 
     be able to store the journal cursor, which is a string. The positions 
     API has been updated to support reading in the old integer values 
     and the new string values. 

* move Dockerfile multi-arch to build and ignore that folder

* docker-driver fix

Signed-off-by: Steven Sheehy <ssheehy@firescope.com>

* adds first version of docker driver

* without logrus and fixes some linter issue

* fix the driver and start a build system

* adds swarm label discovery

* Add documentation and more targets

* make the linter happy 

* indent config.json

* with circleci steps for master and branch

* Review Feebacks

Build promtail on linux and windows, discard artifacts

* add a dev target to deploy the current image in k8s

* impr/clients: Handle TLS config and MTLS for logcli and promtail (#540)

* impr/clients: Handle TLS config and MTLS for logcli and promtail

* fix/tls: Please gofmt...

* impr/clients: use prometheus HTTPClientConfig for logcli and promtail

* fix/promtail: Set proper Client config name

* impr/promtail: Use prometheus HTTPClientConfig configuration

* adapt with master

* address review

* fix conflicts

* address requested changes

* remove file

* add helm dev targets

* adding back assets

* fix review comments

* Review feedback

using an environment variable passed into an arg instead of reading the pod name from a file and the downardApi
added a makefile

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

make clean removes `pkg/promtail/server/ui/assets_vfsdata.go` which meant the `pkg/promtail/server/ui/assets_vfsdata.go: assets` target is never activated causing a build error, updating to make the target hit on `server.go` which has a dependency on the deleted `assets_vfsdata.go` triggering a run of `make assets` before go builds that file (#555)

* add a custom server for loki with assets embedded

* adds a targets page for promtail to see discovered files and labels

* lint fixes

* fix css table size

* add service discovery logic

* add service discovery template

* add promtail pages documentation

* ignored gen file in linter

* switch to golangci-lint linter

* fixes for review comments

Adding `make debug` support to build debug binaries and debug containers which wrap the binary with delve and allow for remote debugging

Signed-off-by: Steven Sheehy <ssheehy@firescope.com>

Signed-off-by: Steven Sheehy <ssheehy@firescope.com>

Signed-off-by: Steven Sheehy <ssheehy@firescope.com>

Signed-off-by: Steven Sheehy <ssheehy@firescope.com>

* Tag with latest


Signed-off-by: Xiang Dai <764524258@qq.com>