Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [apache-mesos]

Apache Mesos abstracts CPU, memory, storage, and other compute resources away from machines (physical or virtual), enabling fault-tolerant and elastic distributed systems to easily be built and run effectively.

Mesos is built using the same principles as the Linux kernel, only at a different level of abstraction. The Mesos kernel runs on every machine and provides applications (e.g., Hadoop, Spark, Kafka, Elastic Search) with APIs for resource management and scheduling across entire datacenter and cloud environments.

Project Features

  • Scalability to 10,000s of nodes
  • Fault-tolerant replicated master and slaves using ZooKeeper
  • Support for Docker containers
  • Native isolation between tasks with Linux Containers
  • Multi-resource scheduling (memory, CPU, disk, and ports)
  • Java, Python and C++ APIs for developing new parallel applications
  • Web UI for viewing cluster state

See the project page for more details.

33 questions
9
votes
1 answer

Best Foundation for Mesos Deployment

We are currently in the process of designing the architecture of our new Apache Mesos cloud setup. The goal is to unify our systems by moving different stacks onto the same architecture. The main workloads are big data analytics using Apache Spark…
awfm9
  • 91
  • 4
7
votes
1 answer

Does CoreOS have a cluster aware job scheduler?

Ive been checking out CoreOS and I'm impressed. Before I found CoreOS I was looking at the Mesos/Marathon/Chronos stack as a "cluster kernel". Given the following comparison: init.d == Mesos+Marathon == CoreOS+Fleet cron == Mesos+Chronos ==…
eSniff
  • 173
  • 5
6
votes
1 answer

How to secure a docker host to not allow rooting

I am trying to make docker on a server more secure. The main problem is that most people say "if a person has access to docker, they can be root too" for an administrator point of few this is not something you would want. To elaborate, they can use…
Erik-Jan Riemers
  • 235
  • 1
  • 2
  • 7
3
votes
0 answers

How can I launch hdfs on Mesos without DC/OS?

From my understand DC/OS is a freemium managed service. Because I'd rather just have a raw Mesos implementation, I'd rather not be dependent on DC/OS and so I just want to know how to implement HDFS on Mesos without it. Unfortunately google is…
Dr.Knowitall
  • 209
  • 1
  • 10
3
votes
1 answer

Is it possible to let a web application use the combined hardware resources of a few server machines using Apache Mesos?

I am studying a framework called Apache Mesos. I am totally new to this framework. According to this website, it can combine your datacenter servers and cloud instances into one shared pool from which any app or framework can draw, as illustrated by…
userpal
  • 593
  • 3
  • 9
  • 17
2
votes
1 answer

How to install Apache Mesos / Marathon on Ubuntu 16.04?

I would like to install Apache Mesos 1.0.0+ and Marathon ideally from a repository without building the package from source. I am following the following guide from Mesosphere: https://open.mesosphere.com/getting-started/install/ which notes that…
Darthtrader
  • 311
  • 1
  • 5
  • 12
2
votes
1 answer

How to ssh to DCOS instances on AWS?

I just followed the steps to create a DCOS 1.7 env. Now when I try to ssh a slave instance it's asking me a password to connect on the machine. Is there a default password, where does this password comes from?
Joan
  • 131
  • 3
2
votes
1 answer

Mesos slave IP for Marathon-launched ( docker container ) service instance

i have a docker image i would like to launch a couple instances of via Mesos/Marathon. i'm using BRIDGE networking in docker, and i would like to pass in the "public" ( i.e. not the container's docker0 net ) address of the mesos slave / docker host…
pgn
  • 213
  • 2
  • 10
2
votes
0 answers

nginx proxy_pass with dynamic upstream servers

We're currently stuck in a situation where we are using nginx as our main frontend server for a set of services backed by a dynamic DNS based service discovery with Mesos-DNS. Our nginx configuration looks a bit like this; http { resolver…
Ashesh
  • 224
  • 1
  • 13
1
vote
0 answers

How to do A/B testing with Marathon and Mesos?

How to do A/B testing with Marathon and Mesos? We're currently investigating an enterprise solution called vamp, but if there are any good open source solutions, that'd be great to know.
ujjain
  • 3,963
  • 15
  • 50
  • 88
1
vote
1 answer

who is killing my docker container?

Mesos → Completed Tasks i Sandbox In stdout file, i can see killTask signal: Received killTask for task sources.b4e2c8e6-5b42-11e7-aec0-024227901b13 Full snap of stdout file is as follows. You can see even after receiving killTask signal my…
ramanKC
  • 11
  • 1
  • 4
1
vote
2 answers

DC/OS installations hangs at 50% of Pre-Flight

I want to test the community editon of DC/OS and I cannot get it to progress past 50% of pre-flight: I followed the gui instructions outlined here and started the installation in verbose mode. This is the last non "GET preflight" output: Using…
Greg
  • 1,557
  • 5
  • 24
  • 35
1
vote
1 answer

Monitor the availability of Marathon Framework

I am using Mesos - Marathon for App deployment and availability, but sometimes marathon freezes. I tried to monitor the tcp port, but during the freeze port is open and thus not able to detect the failure? Any suggestions for the monitoring ?
Anshul Patel
  • 125
  • 4
1
vote
1 answer

Marathon containers load balanced with Haproxy and consul return random 503 requests

Currenty the architecture is organised like this: 192.168.1.10, 192.168.1.11, 192.168.1.12 - mesos master with marathon and consul server 192.168.1.21, 192.168.1.22, 192.168.1.23 - three mesos slave with consul agent Every machine the following…
badc0re
  • 113
  • 5
1
vote
0 answers

Kafka docker container on mesos cluster with marathon

I'm trying to deploy a kafka broker on a docker container on a mesos cluster. Specifically, I have a mesos cluster where I deploy various docker containers using marathon as init system. All the containers have service ports and are accessible via a…
ipetrousov
  • 11
  • 5
1
2 3