Tag Archives: mesos

Couchbase on Mesos using DC/OS and Amazon

May 10, 2016containers, couchbaseapache, containers, couchbase, dcos, docker, mesosarungupta

Couchbase Docker container can easily run on a variety of orchestration platforms:

Couchbase Docker Container
Couchbase on Docker Swarm
Couchbase on Kubernetes
Couchbase on OpenShift 3

Docker container using Apache Mesos and Marathon explained how to setup Mesos, Marathon, and run a simple Docker image. The setup was quite involving and a bit flaky.

It required to download and Install Mesos Master and Slave, ZooKeeper, Docker Engine, and Marathon. In some cases, the correct repo need to be added first. These components need to talk to each and so must be configured accordingly. Even if you get past that setup, how do you monitor the entire infrastructure as one entity?

Meet DC/OS – Datacenter Operating System. Its a distributed operating system using Apache Mesos as its kernel.

dcos-kernel

DC/OS can installed in a variety of ways:

Local using Vagrant
Cloud using Amazon/CloudFormation, Microsoft Azure and Packet
On-prem using CentOS or CoreOS

This blog will show how to setup a DC/OS cluster using CloudFormation templates on Amazon and run a Couchbase Docker container.

Launch DC/OS cluster

Launch DC/OS cluster:
dcos-couchbase-1

Take the defaults:

Give the template a name, select a previously create KeyPair, change the number of slaves:

Take the defaults:

Verify the configuration:

Click on “I acknowledge that …” and on Create to start the template creation.

CloudFormation Stack Status page comes up:

Make sure to choose the appropriate region.

After ~10-15 mins, the status changes:

Wait for the status to change from CREATE_IN_PROGRESS to CREATE_COMPLETE.

Download and Configure DC/OS CLI

DC/OS CLI can be used to manage your cluster nodes, install DC/OS packages, inspect the cluster state, and administer the DC/OS service subcommands.

Install DC/OS CLI on your local machine.

On your CloudFormation Stack Status page, select the created stack, Outputs tab, and copy the address of Mesos master.

Configure the DC/OS CLI to use this cluster:

./bin/dcos config set core.dcos_url https://couchbase-ElasticL-14LTDN783Y89T-1791879285.us-west-1.elb.amazonaws.com
[core.dcos_url]: changed from 'http://couchbase-ElasticL-UJ5K6BOZQX59-570103311.us-west-1.elb.amazonaws.com' to 'https://couchbase-ElasticL-14LTDN783Y89T-1791879285.us-west-1.elb.amazonaws.com'

./bin/dcos config set core.dcos_url https://couchbase-ElasticL-14LTDN783Y89T-1791879285.us-west-1.elb.amazonaws.com

[core.dcos_url]: changed from 'http://couchbase-ElasticL-UJ5K6BOZQX59-570103311.us-west-1.elb.amazonaws.com' to 'https://couchbase-ElasticL-14LTDN783Y89T-1791879285.us-west-1.elb.amazonaws.com'

Authenticate:

./bin/dcos auth login
Removed [core.dcos_acs_token]

Please go to the following link in your browser:

    https://couchbase-ElasticL-14LTDN783Y89T-1791879285.us-west-1.elb.amazonaws.com/login?redirect_uri=urn:ietf:wg:oauth:2.0:oob

Enter authentication token:

./bin/dcos auth login

Removed [core.dcos_acs_token]

Please go to the following link in your browser:

https://couchbase-ElasticL-14LTDN783Y89T-1791879285.us-west-1.elb.amazonaws.com/login?redirect_uri=urn:ietf:wg:oauth:2.0:oob

Enter authentication token:

Enter the URL in the browser, proceed to the unsafe URL:

Copy the token to your clipboard:

Paste the authentication token in the terminal window:

Enter authentication token: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Ik9UQkVOakZFTWtWQ09VRTRPRVpGTlRNMFJrWXlRa015Tnprd1JrSkVRemRCTWpBM1FqYzVOZyJ9.eyJlbWFpbCI6ImFydW4uZ3VwdGFAZ21haWwuY29tIiwiZW1haWxfdmVyaWZpZWQiOnRydWUsImlzcyI6Imh0dHBzOi8vZGNvcy5hdXRoMC5jb20vIiwic3ViIjoiZ29vZ2xlLW9hdXRoMnwxMDExOTUyMTI0MDUxOTA0Njc1MTIiLCJhdWQiOiIzeUY1VE9TemRsSTQ1UTF4c3B4emVvR0JlOWZOeG05bSIsImV4cCI6MTQ2MzM1MjA1MSwiaWF0IjoxNDYyOTIwMDUxfQ.tFOy6GBPhnDbP0hI1ZU6jjlogHi4DX2bAGcdYsLywfCEMmv5OU9fUL88v2Kebjgd6gNAJoDF8QiO8zkQ3c4PGifXjiEoay8USjSWpnMbbezkH3AwIZM_-WNVVm0nfIBnCiY5wIgHkCpG_n4oBGdBbMgggtRPUrwPasNPtC_eYbQfwJeM3ByTUaTsarNe3FERbTpQbhKx2Lfc8Xp8AXuW8Up65SbOZr3Kp_jehiLgR-DL6llB4wZDopf8mjnq_5lpOYMtSaHPTlA33tdnhmHi6dPCPeRQEI1qBM6sWUWKs02kT1u42nOF9IYrKrfkzjb4LxwtZdsQt8Jb8CtJHkU0KA
[core.dcos_acs_token]: set
Login successful!

Enter authentication token: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Ik9UQkVOakZFTWtWQ09VRTRPRVpGTlRNMFJrWXlRa015Tnprd1JrSkVRemRCTWpBM1FqYzVOZyJ9.eyJlbWFpbCI6ImFydW4uZ3VwdGFAZ21haWwuY29tIiwiZW1haWxfdmVyaWZpZWQiOnRydWUsImlzcyI6Imh0dHBzOi8vZGNvcy5hdXRoMC5jb20vIiwic3ViIjoiZ29vZ2xlLW9hdXRoMnwxMDExOTUyMTI0MDUxOTA0Njc1MTIiLCJhdWQiOiIzeUY1VE9TemRsSTQ1UTF4c3B4emVvR0JlOWZOeG05bSIsImV4cCI6MTQ2MzM1MjA1MSwiaWF0IjoxNDYyOTIwMDUxfQ.tFOy6GBPhnDbP0hI1ZU6jjlogHi4DX2bAGcdYsLywfCEMmv5OU9fUL88v2Kebjgd6gNAJoDF8QiO8zkQ3c4PGifXjiEoay8USjSWpnMbbezkH3AwIZM_-WNVVm0nfIBnCiY5wIgHkCpG_n4oBGdBbMgggtRPUrwPasNPtC_eYbQfwJeM3ByTUaTsarNe3FERbTpQbhKx2Lfc8Xp8AXuW8Up65SbOZr3Kp_jehiLgR-DL6llB4wZDopf8mjnq_5lpOYMtSaHPTlA33tdnhmHi6dPCPeRQEI1qBM6sWUWKs02kT1u42nOF9IYrKrfkzjb4LxwtZdsQt8Jb8CtJHkU0KA

[core.dcos_acs_token]: set

Mesos and Marathon UI

Mesos UI is available using the address of the Mesos master:

Click on Services to see Marathon service already installed:

Click on marathon to see the list of tasks:

As expected for a freshly created cluster, no tasks have been assigned yet.

Click on Nodes to see the nodes:

Install and Configure Marathon Load Balancer

DC/OS slave nodes are not directly exposed on the Internet. An “external” load balancer can be configured to expose the tasks running on the slaves.

Marathon-lb, short for Marathon Load Balancer, is a load balancer available as a Mesos service. It is based on HAProxy that provides proxying and load balancing for TCP and HTTP based applications, with features such as SSL support, HTTP compression, health checking and more. Marathon-lb subscribes to Marathon’s event bus and updates the HAProxy configuration in real time.

dcos package install marathon-lb
We recommend a minimum of 0.5 CPUs and 256 MB of RAM available for the Marathon-LB DCOS Service.
Continue installing? [yes/no] yes
Installing Marathon app for package [marathon-lb] version [1.2.1]
Marathon-lb DCOS Service has been successfully installed!
See https://github.com/mesosphere/marathon-lb for documentation.

dcos package install marathon-lb

We recommend a minimum of 0.5 CPUs and 256 MB of RAM available for the Marathon-LB DCOS Service.

Continue installing? [yes/no] yes

Installing Marathon app for package [marathon-lb] version [1.2.1]

Marathon-lb DCOS Service has been successfully installed!

See https://github.com/mesosphere/marathon-lb for documentation.

Marathon service UI will show the LB task running:

AWS Load Balancer allows port 80 and 443 by default. We’ll run a Couchbase server that will be exposed at port 8091.

In CloudFormation Stack Status page, copy the value from Values column of PublicSlaveDnsAddress:

In AWS Console, select Load Balancers, add a new firewall rule to allow port 8091 on TCP:

Run Couchbase Server Docker container on DC/OS

Run Couchbase Server Docker container on DC/OS using the following configuration file:

{
  "id": "couchbase-mesos",
  "container": {
    "type": "DOCKER",
    "docker": {
      "image": "arungupta/couchbase",
      "network": "BRIDGE",
      "portMappings": [
        { "hostPort": 0, "containerPort": 8091, "servicePort": 8091 },
        { "hostPort": 0, "containerPort": 8092, "servicePort": 8092 },
        { "hostPort": 0, "containerPort": 8093, "servicePort": 8093 },
        { "hostPort": 0, "containerPort": 11210, "servicePort": 11210 }
      ],
      "forcePullImage":true
    }
  },
  "instances": 1,
  "cpus": 2.0,
  "mem": 2048,
  "labels":{
    "HAPROXY_GROUP":"external"
  }
}

{

"id": "couchbase-mesos",

"container": {

"type": "DOCKER",

"docker": {

"image": "arungupta/couchbase",

"network": "BRIDGE",

"portMappings": [

{ "hostPort": 0, "containerPort": 8091, "servicePort": 8091 },

{ "hostPort": 0, "containerPort": 8092, "servicePort": 8092 },

{ "hostPort": 0, "containerPort": 8093, "servicePort": 8093 },

{ "hostPort": 0, "containerPort": 11210, "servicePort": 11210 }

"forcePullImage":true

}

"instances": 1,

"cpus": 2.0,

"mem": 2048,

"labels":{

"HAPROXY_GROUP":"external"

}

This configuration file uses arungupta/couchbase image that configures the Couchbase Server using pre-defined Couchbase REST API. This image is Couchbase Docker Image.

cpus and mem attributes define the processing memory needed to run this task.

Give the command to run Couchbase in DC/OS cluster:

~/tools/dcos/dcos/bin/dcos marathon app add couchbase-mesos.json

~/tools/dcos/dcos/bin/dcos marathon app add couchbase-mesos.json

Use the previously copied for PublicSlaveDnsAddress and access the Couchbase Web Console at http://<URI>:8091. In our case, the URL is: http://couchbase-publicsl-vjzmwpa38k6d-429093455.us-west-1.elb.amazonaws.com:8091/index.html.

This shows up the login page as:

Enter the login credentials as Administrator and password:

Click on Sign In to see:

Learn more about Couchbase Web Console.

Marathon UI is updated to show all the running services:

Couchbase Docker image log can be seen in Log Viewer:

And the standard output view:

Mesos dashboard is updated to show the resources that are consumed:

Finally, the complete stack can be deleted from StackFormation template page:

Docker container using Apache Mesos and Marathon

May 5, 2016containerscontainers, docker, marathon, mesosarungupta

Apache Mesos is an open source cluster manager developed at UC Berkeley. It provides resource isolation and sharing across distributed applications.

The figure shows the main components of Mesos. Mesos consists of a master daemon that manages slave daemons running on each cluster node. Mesos frameworks are applications that run on Mesos and run tasks on these slaves. Slaves are either physical or virtual machines, typically from the same provider.

Mesos uses a two-level scheduling mechanism where resource offers are made to frameworks. The Mesos master node decides how many resources to offer each framework, while each framework determines the resources it accepts and what application to execute on those resources.

Marathon is a container orchestration platform running on Mesos. Multiple container formats are supported and Docker is certainly the most common one!

This blog will show how to setup Mesos, Marathon, and run a simple Docker image. This setup is only for the brave of heart. I’m always interested in looking under the hood and that’s what motivated this post. But a future post will show a more seamless install.

Let’s get started!

Configure CentOS VM

Download CentOS and configure the VM as shown:

Install Components

Install the different components required for this setup.

Configure Mesos repo:

[arun@arun-centos ~]$ sudo rpm -Uvh http://repos.mesosphere.com/el/7/noarch/RPMS/mesosphere-el-repo-7-1.noarch.rpm

We trust you have received the usual lecture from the local System
Administrator. It usually boils down to these three things:

    #1) Respect the privacy of others.
    #2) Think before you type.
    #3) With great power comes great responsibility.

[sudo] password for arun:
Retrieving http://repos.mesosphere.com/el/7/noarch/RPMS/mesosphere-el-repo-7-1.noarch.rpm
warning: /var/tmp/rpm-tmp.9ssCDQ: Header V4 RSA/SHA1 Signature, key ID e56151bf: NOKEY
Preparing...                          ################################# [100%]
Updating / installing...
   1:mesosphere-el-repo-7-1           ################################# [100%]

[arun@arun-centos ~]$ sudo rpm -Uvh http://repos.mesosphere.com/el/7/noarch/RPMS/mesosphere-el-repo-7-1.noarch.rpm

We trust you have received the usual lecture from the local System

Administrator. It usually boils down to these three things:

#1) Respect the privacy of others.

#2) Think before you type.

#3) With great power comes great responsibility.

[sudo] password for arun:

Retrieving http://repos.mesosphere.com/el/7/noarch/RPMS/mesosphere-el-repo-7-1.noarch.rpm

warning: /var/tmp/rpm-tmp.9ssCDQ: Header V4 RSA/SHA1 Signature, key ID e56151bf: NOKEY

Preparing... ################################# [100%]

Updating / installing...

1:mesosphere-el-repo-7-1 ################################# [100%]

Install Mesos and Marathon:

[arun@arun-centos ~]$ sudo yum -y install mesos marathon
Loaded plugins: fastestmirror, langpacks
base                                                     | 3.6 kB     00:00
extras                                                   | 3.4 kB     00:00
mesosphere                                               | 2.9 kB     00:00
mesosphere-noarch                                        | 2.9 kB     00:00
updates                                                  | 3.4 kB     00:00
(1/6): base/7/x86_64/group_gz                              | 155 kB   00:00
(2/6): extras/7/x86_64/primary_db                          | 117 kB   00:00
(3/6): mesosphere-noarch/primary_db                        | 2.5 kB   00:00
(4/6): mesosphere/x86_64/primary_db                        |  27 kB   00:00
(5/6): base/7/x86_64/primary_db                            | 5.3 MB   00:01
(6/6): updates/7/x86_64/primary_db                         | 4.1 MB   00:02
Determining fastest mirrors
 * base: mirror.supremebytes.com
 * extras: centos.den.host-engine.com
 * updates: mirror.hmc.edu
Resolving Dependencies
--> Running transaction check
---> Package marathon.x86_64 0:1.1.1-1.0.472.el7 will be installed
---> Package mesos.x86_64 0:0.28.1-2.0.20.centos701406 will be installed
--> Processing Dependency: subversion for package: mesos-0.28.1-2.0.20.centos701406.x86_64
--> Running transaction check
---> Package subversion.x86_64 0:1.7.14-10.el7 will be installed
--> Processing Dependency: subversion-libs(x86-64) = 1.7.14-10.el7 for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_wc-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_subr-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_repos-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_ra_svn-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_ra_neon-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_ra_local-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_ra-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_fs_util-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_fs_fs-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_fs_base-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_fs-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_diff-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_delta-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libsvn_client-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libaprutil-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Processing Dependency: libapr-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64
--> Running transaction check
---> Package apr.x86_64 0:1.4.8-3.el7 will be installed
---> Package apr-util.x86_64 0:1.5.2-6.el7 will be installed
---> Package subversion-libs.x86_64 0:1.7.14-10.el7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package            Arch      Version                       Repository     Size
================================================================================
Installing:
 marathon           x86_64    1.1.1-1.0.472.el7             mesosphere     64 M
 mesos              x86_64    0.28.1-2.0.20.centos701406    mesosphere     30 M
Installing for dependencies:
 apr                x86_64    1.4.8-3.el7                   base          103 k
 apr-util           x86_64    1.5.2-6.el7                   base           92 k
 subversion         x86_64    1.7.14-10.el7                 base          1.0 M
 subversion-libs    x86_64    1.7.14-10.el7                 base          921 k

Transaction Summary
================================================================================
Install  2 Packages (+4 Dependent packages)

Total download size: 96 M
Installed size: 168 M
Downloading packages:
warning: /var/cache/yum/x86_64/7/base/packages/apr-1.4.8-3.el7.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID f4a80eb5: NOKEY
Public key for apr-1.4.8-3.el7.x86_64.rpm is not installed
(1/6): apr-1.4.8-3.el7.x86_64.rpm                          | 103 kB   00:00
(2/6): apr-util-1.5.2-6.el7.x86_64.rpm                     |  92 kB   00:00
(3/6): subversion-1.7.14-10.el7.x86_64.rpm                 | 1.0 MB   00:00
(4/6): subversion-libs-1.7.14-10.el7.x86_64.rpm            | 921 kB   00:00
warning: /var/cache/yum/x86_64/7/mesosphere/packages/mesos-0.28.1-2.0.20.centos701406.x86_64.rpm: Header V4 RSA/SHA1 Signature, key ID e56151bf: NOKEY
Public key for mesos-0.28.1-2.0.20.centos701406.x86_64.rpm is not installed
(5/6): mesos-0.28.1-2.0.20.centos701406.x86_64.rpm         |  30 MB   00:29
(6/6): marathon-1.1.1-1.0.472.el7.x86_64.rpm               |  64 MB   00:36
--------------------------------------------------------------------------------
Total                                              2.6 MB/s |  96 MB  00:36
Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
Importing GPG key 0xF4A80EB5:
 Userid     : "CentOS-7 Key (CentOS 7 Official Signing Key) <security@centos.org>"
 Fingerprint: 6341 ab27 53d7 8a78 a7c2 7bb1 24c6 a8a7 f4a8 0eb5
 Package    : centos-release-7-2.1511.el7.centos.2.10.x86_64 (@anaconda)
 From       : /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-mesosphere
Importing GPG key 0xE56151BF:
 Userid     : "Mesosphere Archive Automatic Signing Key <support@mesosphere.io>"
 Fingerprint: 8102 6d00 04c4 4cf7 ef55 adf8 df7d 54cb e561 51bf
 Package    : mesosphere-el-repo-7-1.noarch (installed)
 From       : /etc/pki/rpm-gpg/RPM-GPG-KEY-mesosphere
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : apr-1.4.8-3.el7.x86_64                                       1/6
  Installing : apr-util-1.5.2-6.el7.x86_64                                  2/6
  Installing : subversion-libs-1.7.14-10.el7.x86_64                         3/6
  Installing : subversion-1.7.14-10.el7.x86_64                              4/6
  Installing : mesos-0.28.1-2.0.20.centos701406.x86_64                      5/6
Created symlink from /etc/systemd/system/multi-user.target.wants/mesos-master.service to /usr/lib/systemd/system/mesos-master.service.
Created symlink from /etc/systemd/system/multi-user.target.wants/mesos-slave.service to /usr/lib/systemd/system/mesos-slave.service.
  Installing : marathon-1.1.1-1.0.472.el7.x86_64                            6/6
Created symlink from /etc/systemd/system/multi-user.target.wants/marathon.service to /usr/lib/systemd/system/marathon.service.
  Verifying  : apr-1.4.8-3.el7.x86_64                                       1/6
  Verifying  : subversion-1.7.14-10.el7.x86_64                              2/6
  Verifying  : apr-util-1.5.2-6.el7.x86_64                                  3/6
  Verifying  : mesos-0.28.1-2.0.20.centos701406.x86_64                      4/6
  Verifying  : marathon-1.1.1-1.0.472.el7.x86_64                            5/6
  Verifying  : subversion-libs-1.7.14-10.el7.x86_64                         6/6

Installed:
  marathon.x86_64 0:1.1.1-1.0.472.el7 mesos.x86_64 0:0.28.1-2.0.20.centos701406

Dependency Installed:
  apr.x86_64 0:1.4.8-3.el7             apr-util.x86_64 0:1.5.2-6.el7
  subversion.x86_64 0:1.7.14-10.el7    subversion-libs.x86_64 0:1.7.14-10.el7

Complete!

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

[arun@arun-centos ~]$ sudo yum -y install mesos marathon

Loaded plugins: fastestmirror, langpacks

base | 3.6 kB 00:00

extras | 3.4 kB 00:00

mesosphere | 2.9 kB 00:00

mesosphere-noarch | 2.9 kB 00:00

updates | 3.4 kB 00:00

(1/6): base/7/x86_64/group_gz | 155 kB 00:00

(2/6): extras/7/x86_64/primary_db | 117 kB 00:00

(3/6): mesosphere-noarch/primary_db | 2.5 kB 00:00

(4/6): mesosphere/x86_64/primary_db | 27 kB 00:00

(5/6): base/7/x86_64/primary_db | 5.3 MB 00:01

(6/6): updates/7/x86_64/primary_db | 4.1 MB 00:02

Determining fastest mirrors

* base: mirror.supremebytes.com

* extras: centos.den.host-engine.com

* updates: mirror.hmc.edu

Resolving Dependencies

--> Running transaction check

---> Package marathon.x86_64 0:1.1.1-1.0.472.el7 will be installed

---> Package mesos.x86_64 0:0.28.1-2.0.20.centos701406 will be installed

--> Processing Dependency: subversion for package: mesos-0.28.1-2.0.20.centos701406.x86_64

--> Running transaction check

---> Package subversion.x86_64 0:1.7.14-10.el7 will be installed

--> Processing Dependency: subversion-libs(x86-64) = 1.7.14-10.el7 for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_wc-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_subr-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_repos-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_ra_svn-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_ra_neon-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_ra_local-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_ra-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_fs_util-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_fs_fs-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_fs_base-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_fs-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_diff-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_delta-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libsvn_client-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libaprutil-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Processing Dependency: libapr-1.so.0()(64bit) for package: subversion-1.7.14-10.el7.x86_64

--> Running transaction check

---> Package apr.x86_64 0:1.4.8-3.el7 will be installed

---> Package apr-util.x86_64 0:1.5.2-6.el7 will be installed

---> Package subversion-libs.x86_64 0:1.7.14-10.el7 will be installed

--> Finished Dependency Resolution

Dependencies Resolved

================================================================================

Package Arch Version Repository Size

================================================================================

Installing:

marathon x86_64 1.1.1-1.0.472.el7 mesosphere 64 M

mesos x86_64 0.28.1-2.0.20.centos701406 mesosphere 30 M

Installing for dependencies:

apr x86_64 1.4.8-3.el7 base 103 k

apr-util x86_64 1.5.2-6.el7 base 92 k

subversion x86_64 1.7.14-10.el7 base 1.0 M

subversion-libs x86_64 1.7.14-10.el7 base 921 k

Transaction Summary

================================================================================

Install 2 Packages (+4 Dependent packages)

Total download size: 96 M

Installed size: 168 M

Downloading packages:

warning: /var/cache/yum/x86_64/7/base/packages/apr-1.4.8-3.el7.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID f4a80eb5: NOKEY

Public key for apr-1.4.8-3.el7.x86_64.rpm is not installed

(1/6): apr-1.4.8-3.el7.x86_64.rpm | 103 kB 00:00

(2/6): apr-util-1.5.2-6.el7.x86_64.rpm | 92 kB 00:00

(3/6): subversion-1.7.14-10.el7.x86_64.rpm | 1.0 MB 00:00

(4/6): subversion-libs-1.7.14-10.el7.x86_64.rpm | 921 kB 00:00

warning: /var/cache/yum/x86_64/7/mesosphere/packages/mesos-0.28.1-2.0.20.centos701406.x86_64.rpm: Header V4 RSA/SHA1 Signature, key ID e56151bf: NOKEY

Public key for mesos-0.28.1-2.0.20.centos701406.x86_64.rpm is not installed

(5/6): mesos-0.28.1-2.0.20.centos701406.x86_64.rpm | 30 MB 00:29

(6/6): marathon-1.1.1-1.0.472.el7.x86_64.rpm | 64 MB 00:36

--------------------------------------------------------------------------------

Total 2.6 MB/s | 96 MB 00:36

Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7

Importing GPG key 0xF4A80EB5:

Userid : "CentOS-7 Key (CentOS 7 Official Signing Key) <security@centos.org>"

Fingerprint: 6341 ab27 53d7 8a78 a7c2 7bb1 24c6 a8a7 f4a8 0eb5

Package : centos-release-7-2.1511.el7.centos.2.10.x86_64 (@anaconda)

From : /etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7

Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-mesosphere

Importing GPG key 0xE56151BF:

Userid : "Mesosphere Archive Automatic Signing Key <support@mesosphere.io>"

Fingerprint: 8102 6d00 04c4 4cf7 ef55 adf8 df7d 54cb e561 51bf

Package : mesosphere-el-repo-7-1.noarch (installed)

From : /etc/pki/rpm-gpg/RPM-GPG-KEY-mesosphere

Running transaction check

Running transaction test

Transaction test succeeded

Running transaction

Installing : apr-1.4.8-3.el7.x86_64 1/6

Installing : apr-util-1.5.2-6.el7.x86_64 2/6

Installing : subversion-libs-1.7.14-10.el7.x86_64 3/6

Installing : subversion-1.7.14-10.el7.x86_64 4/6

Installing : mesos-0.28.1-2.0.20.centos701406.x86_64 5/6

Created symlink from /etc/systemd/system/multi-user.target.wants/mesos-master.service to /usr/lib/systemd/system/mesos-master.service.

Created symlink from /etc/systemd/system/multi-user.target.wants/mesos-slave.service to /usr/lib/systemd/system/mesos-slave.service.

Installing : marathon-1.1.1-1.0.472.el7.x86_64 6/6

Created symlink from /etc/systemd/system/multi-user.target.wants/marathon.service to /usr/lib/systemd/system/marathon.service.

Verifying : apr-1.4.8-3.el7.x86_64 1/6

Verifying : subversion-1.7.14-10.el7.x86_64 2/6

Verifying : apr-util-1.5.2-6.el7.x86_64 3/6

Verifying : mesos-0.28.1-2.0.20.centos701406.x86_64 4/6

Verifying : marathon-1.1.1-1.0.472.el7.x86_64 5/6

Verifying : subversion-libs-1.7.14-10.el7.x86_64 6/6

Installed:

marathon.x86_64 0:1.1.1-1.0.472.el7 mesos.x86_64 0:0.28.1-2.0.20.centos701406

Dependency Installed:

apr.x86_64 0:1.4.8-3.el7 apr-util.x86_64 0:1.5.2-6.el7

subversion.x86_64 0:1.7.14-10.el7 subversion-libs.x86_64 0:1.7.14-10.el7

Complete!

Install ZooKeeper:

[arun@arun-centos ~]$ sudo yum -y install mesosphere-zookeeper
[sudo] password for arun:
Loaded plugins: fastestmirror, langpacks
Loading mirror speeds from cached hostfile
 * base: mirror.supremebytes.com
 * extras: centos.den.host-engine.com
 * updates: mirror.hmc.edu
Resolving Dependencies
--> Running transaction check
---> Package mesosphere-zookeeper.x86_64 0:3.4.6-0.1.20141204175332.centos7 will be installed
--> Finished Dependency Resolution

Dependencies Resolved

==================================================================================================
 Package                  Arch       Version                                 Repository      Size
==================================================================================================
Installing:
 mesosphere-zookeeper     x86_64     3.4.6-0.1.20141204175332.centos7        mesosphere     2.8 M

Transaction Summary
==================================================================================================
Install  1 Package

Total download size: 2.8 M
Installed size: 3.5 M
Downloading packages:
mesosphere-zookeeper-3.4.6-0.1.20141204175332.centos7.x86_64.rpm           | 2.8 MB  00:00:01
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : mesosphere-zookeeper-3.4.6-0.1.20141204175332.centos7.x86_64                   1/1
Created symlink from /etc/systemd/system/multi-user.target.wants/zookeeper.service to /usr/lib/systemd/system/zookeeper.service.
  Verifying  : mesosphere-zookeeper-3.4.6-0.1.20141204175332.centos7.x86_64                   1/1

Installed:
  mesosphere-zookeeper.x86_64 0:3.4.6-0.1.20141204175332.centos7

Complete!

[arun@arun-centos ~]$ sudo yum -y install mesosphere-zookeeper

[sudo] password for arun:

Loaded plugins: fastestmirror, langpacks

Loading mirror speeds from cached hostfile

* base: mirror.supremebytes.com

* extras: centos.den.host-engine.com

* updates: mirror.hmc.edu

Resolving Dependencies

--> Running transaction check

---> Package mesosphere-zookeeper.x86_64 0:3.4.6-0.1.20141204175332.centos7 will be installed

--> Finished Dependency Resolution

Dependencies Resolved

==================================================================================================

Package Arch Version Repository Size

==================================================================================================

Installing:

mesosphere-zookeeper x86_64 3.4.6-0.1.20141204175332.centos7 mesosphere 2.8 M

Transaction Summary

==================================================================================================

Install 1 Package

Total download size: 2.8 M

Installed size: 3.5 M

Downloading packages:

mesosphere-zookeeper-3.4.6-0.1.20141204175332.centos7.x86_64.rpm | 2.8 MB 00:00:01

Running transaction check

Running transaction test

Transaction test succeeded

Running transaction

Installing : mesosphere-zookeeper-3.4.6-0.1.20141204175332.centos7.x86_64 1/1

Created symlink from /etc/systemd/system/multi-user.target.wants/zookeeper.service to /usr/lib/systemd/system/zookeeper.service.

Verifying : mesosphere-zookeeper-3.4.6-0.1.20141204175332.centos7.x86_64 1/1

Installed:

mesosphere-zookeeper.x86_64 0:3.4.6-0.1.20141204175332.centos7

Complete!

Add Docker repo:

[arun@arun-centos ~]$ sudo tee /etc/yum.repos.d/docker.repo <<-'EOF'
[dockerrepo]
name=Docker Repository
baseurl=https://yum.dockerproject.org/repo/main/centos/$releasever/
enabled=1
gpgcheck=1
gpgkey=https://yum.dockerproject.org/gpg
EOF
[sudo] password for arun:
[dockerrepo]
name=Docker Repository
baseurl=https://yum.dockerproject.org/repo/main/centos/$releasever/
enabled=1
gpgcheck=1
gpgkey=https://yum.dockerproject.org/gpg

[arun@arun-centos ~]$ sudo tee /etc/yum.repos.d/docker.repo <<-'EOF'

[dockerrepo]

name=Docker Repository

baseurl=https://yum.dockerproject.org/repo/main/centos/$releasever/

enabled=1

gpgcheck=1

gpgkey=https://yum.dockerproject.org/gpg

EOF

[sudo] password for arun:

[dockerrepo]

name=Docker Repository

baseurl=https://yum.dockerproject.org/repo/main/centos/$releasever/

enabled=1

gpgcheck=1

gpgkey=https://yum.dockerproject.org/gpg

Install Docker:

[arun@localhost ~]$ sudo yum -y install docker-engine
Loaded plugins: fastestmirror, langpacks
Loading mirror speeds from cached hostfile
 * base: mirror.scalabledns.com
 * extras: linux.mirrors.es.net
 * updates: mirrors.adams.net
Resolving Dependencies
--> Running transaction check
---> Package docker-engine.x86_64 0:1.11.1-1.el7.centos will be installed
--> Processing Dependency: docker-engine-selinux >= 1.11.1-1.el7.centos for package: docker-engine-1.11.1-1.el7.centos.x86_64
--> Running transaction check
---> Package docker-engine-selinux.noarch 0:1.11.1-1.el7.centos will be installed
--> Finished Dependency Resolution

Dependencies Resolved

====================================================================================================
 Package                       Arch           Version                      Repository          Size
====================================================================================================
Installing:
 docker-engine                 x86_64         1.11.1-1.el7.centos          dockerrepo          13 M
Installing for dependencies:
 docker-engine-selinux         noarch         1.11.1-1.el7.centos          dockerrepo          28 k

Transaction Summary
====================================================================================================
Install  1 Package (+1 Dependent package)

Total download size: 13 M
Installed size: 54 M
Downloading packages:
warning: /var/cache/yum/x86_64/7/dockerrepo/packages/docker-engine-selinux-1.11.1-1.el7.centos.noarch.rpm: Header V4 RSA/SHA512 Signature, key ID 2c52609d: NOKEY
Public key for docker-engine-selinux-1.11.1-1.el7.centos.noarch.rpm is not installed
(1/2): docker-engine-selinux-1.11.1-1.el7.centos.noarch.rpm                  |  28 kB  00:00:00
(2/2): docker-engine-1.11.1-1.el7.centos.x86_64.rpm                          |  13 MB  00:00:02
----------------------------------------------------------------------------------------------------
Total                                                               5.3 MB/s |  13 MB  00:00:02
Retrieving key from https://yum.dockerproject.org/gpg
Importing GPG key 0x2C52609D:
 Userid     : "Docker Release Tool (releasedocker) <docker@docker.com>"
 Fingerprint: 5811 8e89 f3a9 1289 7c07 0adb f762 2157 2c52 609d
 From       : https://yum.dockerproject.org/gpg
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : docker-engine-selinux-1.11.1-1.el7.centos.noarch                                 1/2
restorecon:  lstat(/var/lib/docker) failed:  No such file or directory
warning: %post(docker-engine-selinux-1.11.1-1.el7.centos.noarch) scriptlet failed, exit status 255
Non-fatal POSTIN scriptlet failure in rpm package docker-engine-selinux-1.11.1-1.el7.centos.noarch
  Installing : docker-engine-1.11.1-1.el7.centos.x86_64                                         2/2
  Verifying  : docker-engine-1.11.1-1.el7.centos.x86_64                                         1/2
  Verifying  : docker-engine-selinux-1.11.1-1.el7.centos.noarch                                 2/2

Installed:
  docker-engine.x86_64 0:1.11.1-1.el7.centos

Dependency Installed:
  docker-engine-selinux.noarch 0:1.11.1-1.el7.centos

Complete!

[arun@localhost ~]$ sudo yum -y install docker-engine

Loaded plugins: fastestmirror, langpacks

Loading mirror speeds from cached hostfile

* base: mirror.scalabledns.com

* extras: linux.mirrors.es.net

* updates: mirrors.adams.net

Resolving Dependencies

--> Running transaction check

---> Package docker-engine.x86_64 0:1.11.1-1.el7.centos will be installed

--> Processing Dependency: docker-engine-selinux >= 1.11.1-1.el7.centos for package: docker-engine-1.11.1-1.el7.centos.x86_64

--> Running transaction check

---> Package docker-engine-selinux.noarch 0:1.11.1-1.el7.centos will be installed

--> Finished Dependency Resolution

Dependencies Resolved

====================================================================================================

Package Arch Version Repository Size

====================================================================================================

Installing:

docker-engine x86_64 1.11.1-1.el7.centos dockerrepo 13 M

Installing for dependencies:

docker-engine-selinux noarch 1.11.1-1.el7.centos dockerrepo 28 k

Transaction Summary

====================================================================================================

Install 1 Package (+1 Dependent package)

Total download size: 13 M

Installed size: 54 M

Downloading packages:

warning: /var/cache/yum/x86_64/7/dockerrepo/packages/docker-engine-selinux-1.11.1-1.el7.centos.noarch.rpm: Header V4 RSA/SHA512 Signature, key ID 2c52609d: NOKEY

Public key for docker-engine-selinux-1.11.1-1.el7.centos.noarch.rpm is not installed

(1/2): docker-engine-selinux-1.11.1-1.el7.centos.noarch.rpm | 28 kB 00:00:00

(2/2): docker-engine-1.11.1-1.el7.centos.x86_64.rpm | 13 MB 00:00:02

----------------------------------------------------------------------------------------------------

Total 5.3 MB/s | 13 MB 00:00:02

Retrieving key from https://yum.dockerproject.org/gpg

Importing GPG key 0x2C52609D:

Userid : "Docker Release Tool (releasedocker) <docker@docker.com>"

Fingerprint: 5811 8e89 f3a9 1289 7c07 0adb f762 2157 2c52 609d

From : https://yum.dockerproject.org/gpg

Running transaction check

Running transaction test

Transaction test succeeded

Running transaction

Installing : docker-engine-selinux-1.11.1-1.el7.centos.noarch 1/2

restorecon: lstat(/var/lib/docker) failed: No such file or directory

warning: %post(docker-engine-selinux-1.11.1-1.el7.centos.noarch) scriptlet failed, exit status 255

Non-fatal POSTIN scriptlet failure in rpm package docker-engine-selinux-1.11.1-1.el7.centos.noarch

Installing : docker-engine-1.11.1-1.el7.centos.x86_64 2/2

Verifying : docker-engine-1.11.1-1.el7.centos.x86_64 1/2

Verifying : docker-engine-selinux-1.11.1-1.el7.centos.noarch 2/2

Installed:

docker-engine.x86_64 0:1.11.1-1.el7.centos

Dependency Installed:

docker-engine-selinux.noarch 0:1.11.1-1.el7.centos

Complete!

Configure Hostname/IP address Mapping

Edit /etc/hosts and create hostname and IP address mapping. Find IP address using ifconfig and choose the network interface enabled during CentOS installation.

Start Services

Start all the services

Start Docker:

[arun@arun-centos ~]$ sudo service docker start
Redirecting to /bin/systemctl start  docker.service

[arun@arun-centos ~]$ sudo service docker start

Redirecting to /bin/systemctl start docker.service

Start ZooKeeper:

sudo systemctl start zookeeper

sudo systemctl start zookeeper

Start Mesos master:

[arun@arun-centos ~]$ sudo service mesos-master start
Redirecting to /bin/systemctl start  mesos-master.service

[arun@arun-centos ~]$ sudo service mesos-master start

Redirecting to /bin/systemctl start mesos-master.service

Configure mesos and docker containerizers:

sudo sh -c "echo 'docker,mesos' > /etc/mesos-slave/containerizers"

sudo sh -c "echo 'docker,mesos' > /etc/mesos-slave/containerizers"

Start Mesos slave:

[arun@arun-centos ~]$ sudo service mesos-slave start
Redirecting to /bin/systemctl start  mesos-slave.service

[arun@arun-centos ~]$ sudo service mesos-slave start

Redirecting to /bin/systemctl start mesos-slave.service

Start Marathon:

[arun@arun-centos ~]$ sudo service marathon start
Redirecting to /bin/systemctl start  marathon.service

[arun@arun-centos ~]$ sudo service marathon start

Redirecting to /bin/systemctl start marathon.service

Check for services:Mesos UI: http://127.0.0.1:5050
Marathon UI: http://127.0.0.1:8080
Logs: tail -f /var/log/messages

[arun@arun-centos log]$ ps aux | grep meso
root      4511  0.1  0.7 3974136 58968 ?       Ssl  19:54   0:04 java -Dzookeeper.log.dir=. -Dzookeeper.root.logger=INFO,CONSOLE -cp /opt/mesosphere/zookeeper/bin/../build/classes:/opt/mesosphere/zookeeper/bin/../build/lib/*.jar:/opt/mesosphere/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/mesosphere/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/opt/mesosphere/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/opt/mesosphere/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/mesosphere/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/mesosphere/zookeeper/bin/../zookeeper-3.4.6.jar:/opt/mesosphere/zookeeper/bin/../src/java/lib/*.jar:/etc/zookeeper/conf: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /etc/zookeeper/conf/zoo.cfg
root     15786  0.0  0.2 754788 19596 ?        Ssl  20:43   0:00 /usr/sbin/mesos-slave --master=zk://localhost:2181/mesos --log_dir=/var/log/mesos
root     15792  0.0  0.0 107892   624 ?        S    20:43   0:00 logger -p user.info -t mesos-slave[15786]
root     15793  0.0  0.0 107892   700 ?        S    20:43   0:00 logger -p user.err -t mesos-slave[15786]
root     15837  1.9  3.0 2818056 239208 ?      Ssl  20:43   0:10 java -Djava.library.path=/usr/local/lib:/usr/lib:/usr/lib64 -Djava.util.logging.SimpleFormatter.format=%2$s%5$s%6$s%n -Xmx512m -cp /usr/bin/marathon mesosphere.marathon.Main --zk zk://localhost:2181/marathon --master zk://localhost:2181/mesos
root     15838  0.0  0.2 829028 22908 ?        Ssl  20:43   0:00 /usr/sbin/mesos-master --zk=zk://localhost:2181/mesos --port=5050 --log_dir=/var/log/mesos --quorum=1 --work_dir=/var/lib/mesos
root     15863  0.0  0.0 107892   620 ?        S    20:43   0:00 logger -p user.info -t mesos-master[15838]
root     15864  0.0  0.0 107892   696 ?        S    20:43   0:00 logger -p user.err -t mesos-master[15838]
arun     16931  0.0  0.0 112644   952 pts/0    R+   20:52   0:00 grep --color=auto meso

[arun@arun-centos log]$ ps aux | grep meso

root 4511 0.1 0.7 3974136 58968 ? Ssl 19:54 0:04 java -Dzookeeper.log.dir=. -Dzookeeper.root.logger=INFO,CONSOLE -cp /opt/mesosphere/zookeeper/bin/../build/classes:/opt/mesosphere/zookeeper/bin/../build/lib/*.jar:/opt/mesosphere/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/mesosphere/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/opt/mesosphere/zookeeper/bin/../lib/netty-3.7.0.Final.jar:/opt/mesosphere/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/mesosphere/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/mesosphere/zookeeper/bin/../zookeeper-3.4.6.jar:/opt/mesosphere/zookeeper/bin/../src/java/lib/*.jar:/etc/zookeeper/conf: -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /etc/zookeeper/conf/zoo.cfg

root 15786 0.0 0.2 754788 19596 ? Ssl 20:43 0:00 /usr/sbin/mesos-slave --master=zk://localhost:2181/mesos --log_dir=/var/log/mesos

root 15792 0.0 0.0 107892 624 ? S 20:43 0:00 logger -p user.info -t mesos-slave[15786]

root 15793 0.0 0.0 107892 700 ? S 20:43 0:00 logger -p user.err -t mesos-slave[15786]

root 15837 1.9 3.0 2818056 239208 ? Ssl 20:43 0:10 java -Djava.library.path=/usr/local/lib:/usr/lib:/usr/lib64 -Djava.util.logging.SimpleFormatter.format=%2$s%5$s%6$s%n -Xmx512m -cp /usr/bin/marathon mesosphere.marathon.Main --zk zk://localhost:2181/marathon --master zk://localhost:2181/mesos

root 15838 0.0 0.2 829028 22908 ? Ssl 20:43 0:00 /usr/sbin/mesos-master --zk=zk://localhost:2181/mesos --port=5050 --log_dir=/var/log/mesos --quorum=1 --work_dir=/var/lib/mesos

root 15863 0.0 0.0 107892 620 ? S 20:43 0:00 logger -p user.info -t mesos-master[15838]

root 15864 0.0 0.0 107892 696 ? S 20:43 0:00 logger -p user.err -t mesos-master[15838]

arun 16931 0.0 0.0 112644 952 pts/0 R+ 20:52 0:00 grep --color=auto meso

Check Mesos master:

[arun@arun-centos ~]$ systemctl status mesos-master
● mesos-master.service - Mesos Master
   Loaded: loaded (/usr/lib/systemd/system/mesos-master.service; enabled; vendor preset: disabled)
   Active: active (running) since Wed 2016-05-04 19:42:24 EDT; 32min ago
 Main PID: 8499 (mesos-master)
   Memory: 14.6M
   CGroup: /system.slice/mesos-master.service
           ├─8499 /usr/sbin/mesos-master --zk=zk://localhost:2181/mesos --port=5050 --log_dir=/va...
           ├─8513 logger -p user.info -t mesos-master[8499]
           └─8514 logger -p user.err -t mesos-master[8499]

May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.564679  8527 master.cpp:3104] Proc...
May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.565058  8527 master.hpp:177] Ad...os)
May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.565093  8527 master.cpp:3589] Laun...
May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.577255  8527 master.cpp:4763] Stat...
May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.577287  8527 master.cpp:4811] F...000
May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.577325  8527 master.cpp:6421] U...ED)
May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.587143  8527 master.cpp:3918] Proc...
May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.587198  8527 master.cpp:6487] Remo...
May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.726095  8527 master.cpp:5324] S...006
May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.728080  8527 master.cpp:3641] P...006
Hint: Some lines were ellipsized, use -l to show in full.

[arun@arun-centos ~]$ systemctl status mesos-master

● mesos-master.service - Mesos Master

Loaded: loaded (/usr/lib/systemd/system/mesos-master.service; enabled; vendor preset: disabled)

Active: active (running) since Wed 2016-05-04 19:42:24 EDT; 32min ago

Main PID: 8499 (mesos-master)

Memory: 14.6M

CGroup: /system.slice/mesos-master.service

├─8499 /usr/sbin/mesos-master --zk=zk://localhost:2181/mesos --port=5050 --log_dir=/va...

├─8513 logger -p user.info -t mesos-master[8499]

└─8514 logger -p user.err -t mesos-master[8499]

May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.564679 8527 master.cpp:3104] Proc...

May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.565058 8527 master.hpp:177] Ad...os)

May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.565093 8527 master.cpp:3589] Laun...

May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.577255 8527 master.cpp:4763] Stat...

May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.577287 8527 master.cpp:4811] F...000

May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.577325 8527 master.cpp:6421] U...ED)

May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.587143 8527 master.cpp:3918] Proc...

May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.587198 8527 master.cpp:6487] Remo...

May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.726095 8527 master.cpp:5324] S...006

May 04 20:14:41 arun-centos mesos-master[8514]: I0504 20:14:41.728080 8527 master.cpp:3641] P...006

Hint: Some lines were ellipsized, use -l to show in full.

Check Mesos slave:

[arun@arun-centos ~]$ systemctl status mesos-slave
● mesos-slave.service - Mesos Slave
   Loaded: loaded (/usr/lib/systemd/system/mesos-slave.service; enabled; vendor preset: disabled)
   Active: active (running) since Wed 2016-05-04 20:00:43 EDT; 12min ago
 Main PID: 9864 (mesos-slave)
   Memory: 57.5M
   CGroup: /system.slice/mesos-slave.service
           ├─9864 /usr/sbin/mesos-slave --master=zk://localhost:2181/mesos --log_dir=/var/log/mes...
           ├─9876 logger -p user.info -t mesos-slave[9864]
           └─9877 logger -p user.err -t mesos-slave[9864]

May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.283629  9887 status_update_manag...000
May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289118  9887 slave.cpp:3990] Cle...000
May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289422  9887 slave.cpp:4078] Cle...000
May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289459  9887 gc.cpp:55] Scheduling ...
May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289489  9887 gc.cpp:55] Scheduli...ure
May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289499  9887 gc.cpp:55] Scheduling ...
May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289511  9887 gc.cpp:55] Scheduli...ure
May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289520  9887 gc.cpp:55] Scheduli...ure
May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289525  9887 gc.cpp:55] Scheduli...ure
May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289533  9887 status_update_manag...000
Hint: Some lines were ellipsized, use -l to show in full.

[arun@arun-centos ~]$ systemctl status mesos-slave

● mesos-slave.service - Mesos Slave

Loaded: loaded (/usr/lib/systemd/system/mesos-slave.service; enabled; vendor preset: disabled)

Active: active (running) since Wed 2016-05-04 20:00:43 EDT; 12min ago

Main PID: 9864 (mesos-slave)

Memory: 57.5M

CGroup: /system.slice/mesos-slave.service

├─9864 /usr/sbin/mesos-slave --master=zk://localhost:2181/mesos --log_dir=/var/log/mes...

├─9876 logger -p user.info -t mesos-slave[9864]

└─9877 logger -p user.err -t mesos-slave[9864]

May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.283629 9887 status_update_manag...000

May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289118 9887 slave.cpp:3990] Cle...000

May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289422 9887 slave.cpp:4078] Cle...000

May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289459 9887 gc.cpp:55] Scheduling ...

May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289489 9887 gc.cpp:55] Scheduli...ure

May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289499 9887 gc.cpp:55] Scheduling ...

May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289511 9887 gc.cpp:55] Scheduli...ure

May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289520 9887 gc.cpp:55] Scheduli...ure

May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289525 9887 gc.cpp:55] Scheduli...ure

May 04 20:13:26 arun-centos mesos-slave[9877]: I0504 20:13:26.289533 9887 status_update_manag...000

Hint: Some lines were ellipsized, use -l to show in full.

Check ZooKeeper:

[arun@arun-centos log]$ /opt/mesosphere/zookeeper/bin/zkCli.sh
Connecting to localhost:2181
log4j:WARN No appenders could be found for logger (org.apache.zookeeper.ZooKeeper).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Welcome to ZooKeeper!
JLine support is enabled

WATCHER::

WatchedEvent state:SyncConnected type:None path:null
[zk: localhost:2181(CONNECTED) 0] ls /mesos
[json.info_0000000001, log_replicas]

[arun@arun-centos log]$ /opt/mesosphere/zookeeper/bin/zkCli.sh

Connecting to localhost:2181

log4j:WARN No appenders could be found for logger (org.apache.zookeeper.ZooKeeper).

log4j:WARN Please initialize the log4j system properly.

log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

Welcome to ZooKeeper!

JLine support is enabled

WATCHER::

WatchedEvent state:SyncConnected type:None path:null

[zk: localhost:2181(CONNECTED) 0] ls /mesos

[json.info_0000000001, log_replicas]

Deploy Docker application to Mesos

A simple Docker-based application is defined using the configuration file. Marathon runs on port 8080 and so the updated configuration file looks like:

{
  "id": "basic-3",
  "cmd": "python3 -m http.server $PORT0",
  "cpus": 0.5,
  "mem": 32.0,
  "container": {
    "type": "DOCKER",
    "docker": {
      "image": "python:3",
      "forcePullImage": true,
      "network": "BRIDGE",
      "portMappings": [
        { "containerPort": 0, "hostPort": 0 }
      ]
    }
  }
}

{

"id": "basic-3",

"cmd": "python3 -m http.server $PORT0",

"cpus": 0.5,

"mem": 32.0,

"container": {

"type": "DOCKER",

"docker": {

"image": "python:3",

"forcePullImage": true,

"network": "BRIDGE",

"portMappings": [

{ "containerPort": 0, "hostPort": 0 }

]

}

Deploy the application as:

curl -X POST http://127.0.0.1:8080/v2/apps -d @app.json -H "Content-type: application/json"

curl -X POST http://127.0.0.1:8080/v2/apps -d @app.json -H "Content-type: application/json"

The application will take some time in order to download the image and then run the container. This setup is slightly sensitive and multiple runs of the application showed that the Docker image was not successfully downloaded all the times. In that case, the Docker image was manually downloaded using docker pull python:3 and then the application could be successfully deployed.

In our case, master and slave are running on the same machine, and so the list of Docker images and running containers can be easily seen:

[arun@localhost ~]$ sudo docker images
REPOSITORY          TAG                 IMAGE ID            CREATED             SIZE
python              3                   67b5207e5d3b        8 days ago          671.1 MB
[arun@localhost ~]$ sudo docker ps
CONTAINER ID        IMAGE               COMMAND                  CREATED             STATUS              PORTS                      NAMES
2ee42b120537        python:3            "/bin/sh -c 'python3 "   About an hour ago   Up About an hour    0.0.0.0:31669->31669/tcp   mesos-d03f6e61-063f-4cae-9c1b-3fc6d8384b3a-S0.b99d82f6-9bc1-4a6f-ae3b-53b7f5d06b95

[arun@localhost ~]$ sudo docker images

REPOSITORY TAG IMAGE ID CREATED SIZE

python 3 67b5207e5d3b 8 days ago 671.1 MB

[arun@localhost ~]$ sudo docker ps

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES

2ee42b120537 python:3 "/bin/sh -c 'python3 " About an hour ago Up About an hour 0.0.0.0:31669->31669/tcp mesos-d03f6e61-063f-4cae-9c1b-3fc6d8384b3a-S0.b99d82f6-9bc1-4a6f-ae3b-53b7f5d06b95

The application is available at port 31669 and can be seen at http://127.0.0.1:31669 as:

Mesos UI (http://127.0.0.1:5050) shows:

Marathon UI (http://127.0.0.1:8080) shows:
mesos-ui-app-output

As you can see, this is quite an involving setup. A future blog post will show how to use DC/OS and set this up more seamlessly.

Miles to go 4.0 …

Arun Gupta is a technology enthusiast, avid runner, author of a best-selling book, globe trotter, a community guy, Java Champion, JavaOne Rockstar, JUG Leader, Minecraft Modder, NetBeans Dream Teamer, Devoxx4Kids-er, Docker Captain and works at AWS.

Tag Archives: mesos

Couchbase on Mesos using DC/OS and Amazon

Launch DC/OS cluster

Download and Configure DC/OS CLI

Mesos and Marathon UI

Install and Configure Marathon Load Balancer

Run Couchbase Server Docker container on DC/OS

Docker container using Apache Mesos and Marathon

Configure CentOS VM

Install Components

Configure Hostname/IP address Mapping

Start Services

Deploy Docker application to Mesos