I am looking for a way to build a pipeline for storing the logs data (I use the ELK stack) to AWS Redshift, for analytics.
I have gone through the Output plugins for ElasticSearch, and found one for writing data to AWS S3. But, it writes data in batches and dealing with S3 is slow.
So, is there any way I can build a pipeline from my ELK stack to Redshift for my logs data?
Update: The ELK stack cluster is hosted on an EC2 VPC