Zerops x Elastic Stack

Elastic is a distributed search and analytics engine at the core of the Elastic Stack, designed for storing, searching, and analyzing large volumes of structured and unstructured data in near real-time.

Elastic ELK

ELK (Elastic Stack) is a powerful open-source suite for centralized logging, monitoring, and analytics, consisting of Elasticsearch for indexing and searching, Logstash for data processing, and Kibana for visualizing the data.

Paste the following yml to Zerops GUI:

project:
  name: recipe-elk
  tags:
    - zerops-recipe
services:
  - hostname: elkstorage
    type: [email protected]
    mode: NON_HA
    priority: 10

  - hostname: kibana
    type: [email protected]
    buildFromGit: https://github.com/zeropsio/recipe-elk
    enableSubdomainAccess: true
    verticalAutoscaling:
      minRam: 1
    maxContainers: 1

  - hostname: logstash
    type: [email protected]
    buildFromGit: https://github.com/zeropsio/recipe-elk
    verticalAutoscaling:
      minRam: 1
    maxContainers: 1

To collect all Zerops logs with Logstash, set the following custom log forwarding (through GUI):

destination d_logstash {
  udp("logstash" port(1514));
};

log {
  source(s_src); destination(d_logstash);
};

Login to Kibana:

• user: elastic
• password: password environment variable of service elkstorage (can be found in GUI)

Forward Logs from External Sources

In order to send logs from other projects too, one must enable the "Public Access through IP Addresses".

1. Navigate to recipe-elk project > logstash service > "Direct access through IP address" menu > "Open port on IPv6"

2. Paste this to the logs source project "Log Forwarding", replace <elk-project-public-ipv6> (without [] brackets)

destination d_logstash {
  tcp6("<elk-project-public-ipv6>" port(1514));
};

log {
  source(s_src); destination(d_logstash);
};

Elastic APM

Elastic APM is a performance monitoring tool that hooks into your app to track latency, errors, and transactions across your stack, giving you real-time insights for debugging and optimizing code.

Paste the following yml to Zerops GUI:

project:
  name: recipe-elk
  tags:
    - zerops-recipe
services:
  - hostname: elkstorage
    type: [email protected]
    mode: NON_HA
    priority: 10

  - hostname: kibana
    type: [email protected]
    buildFromGit: https://github.com/zeropsio/recipe-elk
    enableSubdomainAccess: true
    verticalAutoscaling:
      minRam: 1
    maxContainers: 1

  - hostname: apmserver
    type: [email protected]
    buildFromGit: https://github.com/zeropsio/recipe-elk
    maxContainers: 1
    envSecrets:
      SECRET_TOKEN: <@generateRandomString(<32>)>