aws-cloudformationamazon-data-pipeline

Can I have a data-pipeline as a part of my cloud-formation template?


My app has a S3 bucket with daily feeds, 2 DynamoDB tables that stores this data, an ELB application that exposes the JSON API to that data and a data pipeline flow that processes the incoming data and uploads into the tables.

My CloudFormation template currently builds the tables and the ELB app. I'd want the pipeline flow to be a part of the template too (so a complete staging environment, for example, will be built together).

I couldn't find references for that in the manuals. Does anyone know how to do it or can confirm that it's officially not supported?

Zach


Solution

  • Editing my previous answer as Cloudformation has been supporting Data Pipeline.

    https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-datapipeline-pipeline.html

    As @SmartFingers noted, Data Pipeline is offered in fewer regions (although AWS has been adding) than Cloudformation itself.

    https://aws.amazon.com/about-aws/whats-new/2014/02/20/aws-data-pipeline-now-available-in-four-new-regions/