Questions tagged [elasticsearch]

Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine.

Elasticsearch is a flexible and powerful open source, distributed, real-time search and analytics engine. Architected from the ground up for use in distributed environments where reliability and scalability are must haves, Elasticsearch gives you the ability to move easily beyond simple full-text search. Through its robust set of APIs and query DSLs, plus clients for the most popular programming languages, Elasticsearch delivers on the near limitless promises of search technology.

http://www.elasticsearch.org

373 questions
1
vote
1 answer

Why SSL does not work between my 2 servers?

I have 2 servers with Ubuntu 18.04: monitoring.example.com (with ELK on a single server) www.example.com (with Filebeat) on the server ELK Create directories to store SSL certificates $ sudo mkdir -p /etc/elk-certs Generate SSL Certificates $ sudo…
tropcool
  • 13
  • 4
1
vote
0 answers

AWS : Replicate Amazon Elastic search and RDS

We are working on an AWS system where we are using Amazon RDS for database purposes and ElasticSearch for indexing. We have a requirement that we require weekly backup of both the services along with an EBS drive. This way we are able to maintain…
Allscool
  • 11
  • 1
1
vote
1 answer

Cannot connect to open port in remote server

On my remote server, I installed ElasticSearch, which can be accessed at http://localhost:9200/: I defined an inbound security rule, Port9200, in the firewall for my remote server: As you can see, Port 9200 is publicly accessible to…
M.Y. Babt
  • 121
  • 1
  • 5
1
vote
1 answer

Connect MongoDB to ElasticSearch by MongoConnector in Kubernetes

I have a MongoDB and ElasticSearch cluster which I've run by Kubernetes. I am trying to connect my ElasticSearch to MongoDB on Kubernetes but I can't find any relevant document. Can anyone help me on this?
1
vote
0 answers

ElasticSearch not starting properly

On startup, our ElasticSearch server throws aJava exception I can see in the elasticsearch.log: [2019-02-27T15:51:59,908][WARN ][o.e.m.j.JvmGcMonitorService] [KibjtLy] [gc][young][263][19] duration [4.1s], collections [1]/[4.4s], total…
Alexis Dufrenoy
  • 235
  • 1
  • 3
  • 11
1
vote
0 answers

VPC subnet error when deploying Bitname Elasticsearch to non-default GCE network

Deploying Bitnami's single-VM Elasticsearch. The error is: Invalid value for field 'resource.networkInterfaces[0]': ''. Subnetwork should be specified for custom subnetmode network It works fine if I deploy it to my default network, but I get this…
Isvara
  • 215
  • 1
  • 12
1
vote
1 answer

Logstash's ElasticSearch Input Plugin should be used to output to ElasticSearch

We hope to use ElasticSearch Input Plugin from Logstash to output with ElasticSearch. This feature has been successfully collected by MongoDB Input Plugin in real time. However, the ElasticSearch Input Plugin does not start with the data that you…
junsung kang
  • 15
  • 1
  • 6
1
vote
1 answer

ELK Logs from application disappearing when grok rules are enabled

We have two instances of an application (same application, different database), lets call them app1 and app2. The route the logs take is: appX runs filebeat, which picks up the applications log file tags it with appX, and sends each entry to an…
GeoSword
  • 1,647
  • 12
  • 16
1
vote
1 answer

memory locking requested for elasticsearch process but memory is not locked

ElasticSearch 5.6.7 throws somewhat misleading following error and refuse to start: [2018-08-02T10:07:50,333][ERROR][o.e.b.Bootstrap ] [esm56n3] node validation exception [2] bootstrap checks failed [1]: memory locking requested for…
1
vote
1 answer

esrally.exceptions.SystemSetupError: ('JAVA_HOME points to JDK 8 but it should point to JDK 10.', None) when running a race on esrally

The Dockerfile of my docker 17.03.1-ce is as follows FROM ubuntu:16.04 # Specifying versions is better?? RUN apt-get update && \ apt-get install -y \ python3 \ python3-pip \ git \ …
1
vote
3 answers

nginx serve Elasticsearch and Kibana on the same host

Totally new to nginx, I need a conf file to make nginx act as a reverse proxy to serve request on the same host to elasticsearch and kibana with different url path. I mean, I want: localhost/es -> localhost:9200 localhost/kibana ->…
koopa
  • 75
  • 1
  • 6
1
vote
0 answers

Configure Google Cloud Storage plugin with Curator cronjob on GKE Elasticsearch cluster

I deployed an Elasticsearch cluster on GKE, using this project as a starting point: https://github.com/pires/kubernetes-elasticsearch-cluster I would like to configure two Curator jobs by using Kubernetes CronJob objects, to snapshot the indices,…
1
vote
2 answers

How to move/migrate indices from self hosted Elasticsearch to AWS Elasticsearch service (cloud)

I have a self hosted Elasticsearch 6.2 cluster (2 master nodes, ~200Gb data each). I plan to move to AWS Elasticsearch service & it's not possible to ssh into it. What's the fastest way to move all indices from an old ES cluster to the cloud one? On…
GTXBxaKgCANmT9D9
  • 395
  • 1
  • 6
  • 15
1
vote
1 answer

CloudWatch Logs, Elasticsearch service expiration

I'm using CloudWatch Logs streaming to Amazon Elasticsearch service (https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/CWL_ES_Stream.html) Currently, I've set Events expiration in Cloudwatch to 7 days for my Cloudwatch log group that is…
allaire
  • 185
  • 1
  • 10
1
vote
1 answer

Local Logstash failing to forward /var/log/syslog to central Logstash

I want my local instance of Logstash to forward syslog and all /var/log/* files to a remote, central instance of Logstash. The pipeline in /etc/logstash/conf/logstash-local.conf looks as follows: input { file { type => "syslog" path => […
0xF2
  • 187
  • 8