diff --git a/docs/operations.md b/docs/operations.md index 352fee773855bf9452995069038deea70508499d..2f498a512798b91762c38116dd653a4c716f8ffb 100644 --- a/docs/operations.md +++ b/docs/operations.md @@ -83,4 +83,47 @@ Take a look at our [production setup](https://github.com/grafana/loki/blob/a422f #### AWS S3 & DynamoDB -Take a look at our [s3-dynamodb setup](./aws_storage.md) + +##### Example config via yaml file +```yaml +schema_config: + configs: + - from: 0 + store: dynamo + object_store: s3 + schema: v9 + index: + prefix: dynamodb_table_name + period: 0 +storage_config: + aws: + s3: s3://access_key:secret_access_key@region/bucket_name + dynamodbconfig: + dynamodb: dynamodb://access_key:secret_access_key@region +``` + +###### S3 + +Loki is using S3 as object storage. It stores log within directories based on +[`OrgID`](./operations.md#Multi-tenancy). For example, Logs from org `faker` +will stored in `s3://BUCKET_NAME/faker/`. + +The S3 configuration is setup with url format: `s3://access_key:secret_access_key@region/bucket_name`. + +###### Dynamo DB + +Loki uses dynamodb for the index storage. It is used for querying logs, make +sure you adjuest your throughput to your usage. + +DynamoDB access is very similar to S3, however you do not need to specific a +table name in the storage section. You will need to set the table name for +`index.prefix` inside schema config section. + +You can setup DynamoDB by yourself, or have `table-manager` setup for you. +You can find out more info about table manager at +[cortex project](https://github.com/cortexproject/cortex)(https://github.com/cortexproject/cortex). +There is an example table manager deployment inside the ksonnet deployment method. You can find it [here](../production/ksonnet/loki/table-manager.libsonnet) + +####### Manual setup +You will need to setup primary index key `h`(string) and `r`(binary) as the sort +key. Make sure adjust your throughput base on your usage.