How to modify the size of RAM requirement of aurora task in Heron cluster deployed on Aurora scheduler?
I deployed Heron cluster using aurora-scheduler and Mesos. And when I ran the default WordCountTopology using this cluster, I found the ram demand of aurora task is 4G. However, the WordCountToplogy's configuration as follows:
componentRam: 1G
containerRamRequested: 1G
containerCpuRequested: 2 cores
containerDiskRequeted: 2G
Aurora task.json content is:
It shows that this task of aurora needs 4g ram resources. But I don't know why it requests 4G ram. And how to modified this ram requirement?
In addition, there are two slave hosts in my heron cluster and these host resources is:
In addition to the Ram requested by topology's components, there are some additional resources(cpu, memory) requested for heron's daemon processes,e.g stream-manager. Packing additional CPU in RR
A second cause for the larger resource request is due to Aurora only allows homogeneous containers. The packing algorithm will pick maximum container resources as the resource request for all the containers. For example, if a topology has two containers: one requests 2 cpus and the other requests 3 cpus. Then the eventually all containers will request 3 cpus.
- How to force marathon to redo the deployment of an already running container with the existing version `:latest`?
- Release PORT 53 | Mesos-DNS on Marathon
- Where can I find binary packages for Apache Mesos?
- Can Apache Spark run without Hadoop?
- Which cluster type should I choose for Spark?
- Configuring a self hosted GitLab-CE CI/CD server in parallel with a GitHub Team account
- Can we run two 'slave' nodes on the same machines?
- Add new slave without stopping master?
- I wonder why many resource managers (Yarn, Mesos, Kubernetes etc.) do not support setting the disk I/O resource usage of containers
- Recovering from Consul "No Cluster leader" state
- Standalone Manager Vs. Yarn Vs. Mesos
- Consul deregister 'failing' services
- Does a Mesos slave needs to be contacted by a Mesos master?
- Is Celery a "real" scheduler like PBS, MESOS or YARN?
- ISO 8601 Repeating Interval: every last day of month
- spark-submit --status with mesos master returns nothing
- How to disable apache mesos memory/disk isolation?
- The command status stop "Creating job WordCountTopology" after submit a Topology
- How to modify the size of RAM requirement of aurora task in Heron cluster deployed on Aurora scheduler?
- Aurora file define host port
- Resize Apache Aurora's Vagrant
- How to find the Heron scheduler files when deployed it on Aurora and Mesos?
- Aurora scheduler doesn't start
- Aurora Instances are always pending status after submitted Heron Topology
- Start Apache Mesos slave with Docker containerizer
- What does it mean for the application developer to run an application in Kubernetes?
- Launching jobs with large docker images in mesos via aurora can be slow
- force pull docker image in Apache Aurora
- Does Apache Aurora have an API?
- Mesos DCOS doesn't install Kafka