Fluent Bit is an open source Log Processor and Forwarder which allows you to collect any data like metrics and logs from different sources. Helm is a tool for managing packages of pre-configured Kubernetes resources using Charts. You can use this Helm chart to ship Kubernetes logs to Logz.io with Fluent Bit.

This chart is based on the fluent-bit Helm chart.

Sending logs from nodes with taints

If you want to ship logs from any of the nodes that have a taint, make sure that the taint key values are listed in your in your daemonset/deployment configuration as follows:

tolerations:
- key: 
  operator: 
  value: 
  effect:

To determine if a node uses taints as well as to display the taint keys, run:

kubectl get nodes -o json | jq ".items[]|{name:.metadata.name, taints:.spec.taints}"

You need to use Helm client with version v3.9.0 or above.

Enabling multiline logs parser

If you want to enable parsing for multiline logs, add the following code to values.yaml under the customParsers parameter:

customParsers:
  [MULTILINE_PARSER]
      name          multiline-regex-test
      type          regex
      flush_timeout 1000

Standard configuration

Add logzio-helm repo
helm repo add logzio-helm https://logzio.github.io/logzio-helm
helm repo update
Run the Helm deployment code
helm install  \
--set logzio.token=<<LOG-SHIPPING-TOKEN>> \
--set logzio.listenerHost=<<LISTENER-HOST>> \
--set logzio.logType=<<LOG-TYPE>> \
logzio-fluent-bit logzio-helm/logzio-fluent-bit

Replace <<LISTENER-HOST>> with the host for your region. For example, listener.logz.io if your account is hosted on AWS US East, or listener-nl.logz.io if hosted on Azure West Europe. The required port depends whether HTTP or HTTPS is used: HTTP = 8070, HTTPS = 8071. Replace <<LOG-SHIPPING-TOKEN>> with the token of the account you want to ship to. If required, replace <<LOG_TYPE>> with the desired name for the log type, the default value is fluentbit.

Check Logz.io for your logs

Give your logs some time to get from your system to ours, then open Logz.io.

Customizing Helm chart parameters

Configure customization options

You can use the following options to update the Helm chart parameters:

  • Specify parameters using the --set key=value[,key=value] argument to helm install

  • Edit the values.yaml

  • Overide default values with your own my_values.yaml and apply it in the helm install command.

Example
helm install logzio-fluent-bit logzio-helm/logzio-fluent-bit -f my_values.yaml

To modify fluentbit configuration, edit the config section in values.yaml.

Uninstalling the Chart

The Uninstall command is used to remove all the Kubernetes components associated with the chart and to delete the release.

To uninstall the logzio-fluent-bit deployment, use the following command:

helm uninstall logzio-fluent-bit