Which Service Should I Use To Run Scheduled Task On AWS?
I have a apache beam program on python. To save running cost I would like to executed this python using service instead of on EC2 instance.
The script lasts from 50s to over 60min.
If this is GCP I think google app engine. However, on AWS, I am not sure whether I should use AWS beanstalk or AWS batch .
Generally, which service is best to run long running script on AWS?
Thanks, Yu
Answer
AWS Batch is recommended for batch processing at any scale, However AWS Elastic Beanstalk is an easy-to-use service for deploying and scaling web applications.
Also there is no additional charge for both the services AWS batch & AWS Elastic Beanstalk. You pay for AWS resources (e.g. EC2 instances or AWS Lambda functions) you create to store and run your application.
In your case Apache Beam is used which is an unified model and set of language-specific SDKs for defining and executing data processing workflows/pipelines which fall under category of batch processing.
References:
Related Questions
- → What are the pluses/minuses of different ways to configure GPIOs on the Beaglebone Black?
- → Django, code inside <script> tag doesn't work in a template
- → React - Django webpack config with dynamic 'output'
- → GAE Python app - Does URL matter for SEO?
- → Put a Rendered Django Template in Json along with some other items
- → session disappears when request is sent from fetch
- → Python Shopify API output formatted datetime string in django template
- → Can't turn off Javascript using Selenium
- → WebDriver click() vs JavaScript click()
- → Shopify app: adding a new shipping address via webhook
- → Shopify + Python library: how to create new shipping address
- → shopify python api: how do add new assets to published theme?
- → Access 'HTTP_X_SHOPIFY_SHOP_API_CALL_LIMIT' with Python Shopify Module