1. 程式人生 > >Stop and Start Amazon EC2 Instances with Data Pipeline

Stop and Start Amazon EC2 Instances with Data Pipeline

You can use AWS Data Pipeline to programmatically start and stop your EC2 instances at scheduled instances. Data Pipeline uses AWS technologies and runs AWS Command Line Interface (AWS CLI) commands on a set schedule with no external dependencies. Data Pipeline writes logs to Amazon Simple Storage Service (Amazon S3), and runs in the context of an IAM role, which eliminates key management requirements. Data Pipeline is also cost effective. For example, the Data Pipeline free tier can be used to stop and start instances once per day. For more information, see

AWS Data Pipeline Pricing.

Note: An Amazon EC2 t1.micro instance is started as the host environment for execution of a data pipeline. EC2 instances started for this purpose run for a default timeout period of 50 minutes. All resources used to host execution of a data pipeline accrue to your account. Executing pipelines to stop and restart an EC2 instance for 100 minutes or less uses the same amount of resources as are used by letting an EC2 t1.micro instance continue to run.

You should stop and restart one or more EC2 t1.micro or larger instances for more than 100 minutes (50 minutes to stop, and 50 minutes to start) to be sure that the method described in this article doesn't consume more resources than are conserved.

Data Pipeline requires that you create a customer managed policy for the DataPipelineDefaultResourceRole

role if the default policy associated with this role is the AmazonEC2RoleforDataPipelineRole AWS managed policy, because AWS managed policies are read-only. If the policy attached to your DataPipelineDefaultResourceRole is not an AWS managed policy, then you don't need to create a customer managed policy. Instead, you can edit the policy assigned to theDataPipelineDefaultResourceRolerole.

相關推薦

Stop and Start Amazon EC2 Instances with Data Pipeline

You can use AWS Data Pipeline to programmatically start and stop your EC2 instances at scheduled instances. Data Pipeline uses AWS technologies

New – Amazon EC2 Instances with Up to 8 NVIDIA Tesla V100 GPUs (P3)

Driven by customer demand and made possible by on-going advances in the state-of-the-art, we’ve come a long way since the original m1.small instan

I need more Amazon EC2 instances, but I've reached my limit

Amazon Web Services is Hiring. Amazon Web Services (AWS) is a dynamic, growing business unit within Amazon.com. We are currently hiring So

Facing Load Balancer to EC2 Instances with Private IP Addresses

You must create public subnets in the same Availability Zones as the private subnets that are used by your private instances. Then associate th

time bushfire alerting with Complex Event Processing in Apache Flink on Amazon EMR and IoT sensor network | AWS Big Data Blog

Bushfires are frequent events in the warmer months of the year when the climate is hot and dry. Countries like Australia and the United States are

I want to migrate instances between my local virtualization environment and Amazon EC2

Amazon Web Services is Hiring. Amazon Web Services (AWS) is a dynamic, growing business unit within Amazon.com. We are currently hiring So

How to Break a Monolith Application into Microservices with Amazon Elastic Container Service, Docker, and Amazon EC2

Traditional monolithic architectures are hard to scale. As an application's code base grows, it becomes complex to update and maintain.

Prepare Environment for Working with AWS CLI and Amazon DynamoDB on Amazon EC2

Amazon Web Services is Hiring. Amazon Web Services (AWS) is a dynamic, growing business unit within Amazon.com. We are currently hiring So

First Contaction with Data Image Processing and Some Social Problems That This Technology Can Solve

In the class I had in last term, I first contacted the data image processing. Images in the computer can be roughly divided into binary images, gr

Data Digest: AI, Big Data Analytics, and Security; More AI Apps Transforming Data with Intelligence

How AI, machine learning, and big data analytics can help cybersecurity, and examples of real applications for AI and machine learning. A new survey indica

What do Climate Change, Data Centres and Cloud have to do with each other?

What do Climate Change, Data Centres and Cloud have to do with each other?Last week I did a talk titled Serverless is the Future (or is it?) (link to video

Amazon Files for Patent to Detect User Illness and Emotional State by Analyzing Voice Data

Amazon yesterday filed a patent with the U.S. Patent and Trademark Office related to detecting physical and emotional wellbeing of users based on interacti

Building a Big Data Pipeline With Airflow, Spark and Zeppelin

Building a Big Data Pipeline With Airflow, Spark and Zeppelin“black tunnel interior with white lights” by Jared Arango on UnsplashIn this data-driven era,

Amazon brings predictive scaling to EC2 instances

Amazon Web Services this week is improving its Auto Scaling tool with machine learning, giving it predictive capabilities. The new predictive scaling featu

Amazon EC2 z1d Instances

Many workloads such as electronic design automation (EDA) and relational databases have high per core software licensing fees. Semiconductor firms

AWS | Amazon EC2 Dedicated Instances

*This is the average monthly payment over the course of the Reserved Instance term. For each month, the actual monthly payment will equal the a

Amazon EC2 High Memory Instances

EC2 High Memory instances offer 6 TB, 9 TB, and 12 TB of memory in an instance. These instances are purpose-built to run large in-memory databases

Amazon EC2 Reserved Instances

EC2 RIs provide a discounted hourly rate and an optional capacity reservation for EC2 instances. AWS Billing automatically applies your RI’s d

Enable and Configure Enhanced Networking for EC2 Instances

Enhanced networking provides higher bandwidth, higher packet-per-second (PPS) performance, and consistently lower inter-instance latencies.