AWS EMR Cluster Creation Task: Difference between revisions
Jump to navigation
Jump to search
m (Text replacement - ". * <B>Counter-Exam" to ". ** … * <B>Counter-Exam ") |
m (Text replacement - "xam ple" to "xample") |
||
| Line 6: | Line 6: | ||
** <code>alias create-cluster='aws emr create-cluster --name "iPythonNLTKSparkEMR" --applications Name=Hadoop Name=Spark Name=Ganglia --release-label emr-4.7.1 --region us-east-1 --tags Name=EMR --bootstrap-actions '"'"'[{"Path":"s3://ipython-v01/install-ipython-notebook-withPySpark.sh","Name":"Custom action"}]'"'"' --ec2-attributes '"'"'{"KeyName":"GM-EMR","InstanceProfile":"EMR_EC2_DefaultRole","AvailabilityZone":"us-east-1a","EmrManagedSlaveSecurityGroup":"sg-b6fb13a0","EmrManagedMasterSecurityGroup":"sg-4efb1358"}'"'"' --service-role EMR_DefaultRole --enable-debugging --log-uri "s3n://aws-logs-747579156672-us-east-1/elasticmapreduce/" --instance-groups '"'"'[{"InstanceCount":1,"BidPrice":"0.10","InstanceGroupType":"CORE","InstanceType":"m3.xlarge","Name":"Core instance group - 2"},{"InstanceCount":1,"BidPrice":"0.15","InstanceGroupType":"MASTER","InstanceType":"m3.xlarge","Name":"Master instance group - 1"}]'"'"''</code>. | ** <code>alias create-cluster='aws emr create-cluster --name "iPythonNLTKSparkEMR" --applications Name=Hadoop Name=Spark Name=Ganglia --release-label emr-4.7.1 --region us-east-1 --tags Name=EMR --bootstrap-actions '"'"'[{"Path":"s3://ipython-v01/install-ipython-notebook-withPySpark.sh","Name":"Custom action"}]'"'"' --ec2-attributes '"'"'{"KeyName":"GM-EMR","InstanceProfile":"EMR_EC2_DefaultRole","AvailabilityZone":"us-east-1a","EmrManagedSlaveSecurityGroup":"sg-b6fb13a0","EmrManagedMasterSecurityGroup":"sg-4efb1358"}'"'"' --service-role EMR_DefaultRole --enable-debugging --log-uri "s3n://aws-logs-747579156672-us-east-1/elasticmapreduce/" --instance-groups '"'"'[{"InstanceCount":1,"BidPrice":"0.10","InstanceGroupType":"CORE","InstanceType":"m3.xlarge","Name":"Core instance group - 2"},{"InstanceCount":1,"BidPrice":"0.15","InstanceGroupType":"MASTER","InstanceType":"m3.xlarge","Name":"Master instance group - 1"}]'"'"''</code>. | ||
** … | ** … | ||
* <B>Counter- | * <B>Counter-Example(s):</B> | ||
** an [[EMR Terminate Cluster Task]]. | ** an [[EMR Terminate Cluster Task]]. | ||
** an [[EMR Resize Cluster Task]]. | ** an [[EMR Resize Cluster Task]]. | ||
Latest revision as of 06:47, 7 January 2023
An AWS EMR Cluster Creation Task is a create cluster task that creates an EMR cluster.
- Context:
- It can be a component of AWS EMR Cluster Management.
- …
- Example(s):
alias create-cluster='aws emr create-cluster --name "iPythonNLTKSparkEMR" --applications Name=Hadoop Name=Spark Name=Ganglia --release-label emr-4.7.1 --region us-east-1 --tags Name=EMR --bootstrap-actions '"'"'[{"Path":"s3://ipython-v01/install-ipython-notebook-withPySpark.sh","Name":"Custom action"}]'"'"' --ec2-attributes '"'"'{"KeyName":"GM-EMR","InstanceProfile":"EMR_EC2_DefaultRole","AvailabilityZone":"us-east-1a","EmrManagedSlaveSecurityGroup":"sg-b6fb13a0","EmrManagedMasterSecurityGroup":"sg-4efb1358"}'"'"' --service-role EMR_DefaultRole --enable-debugging --log-uri "s3n://aws-logs-747579156672-us-east-1/elasticmapreduce/" --instance-groups '"'"'[{"InstanceCount":1,"BidPrice":"0.10","InstanceGroupType":"CORE","InstanceType":"m3.xlarge","Name":"Core instance group - 2"},{"InstanceCount":1,"BidPrice":"0.15","InstanceGroupType":"MASTER","InstanceType":"m3.xlarge","Name":"Master instance group - 1"}]'"'".- …
- Counter-Example(s):
- an EMR Terminate Cluster Task.
- an EMR Resize Cluster Task.
- an EMR Query Cluster Task, such as:
aws emr describe-cluster --cluster-id j-PXP2ECF90LOR | grep -i dns
- See: DBMS Instance Creation Task.