Completed

Host the airflow on an Ec2

Published on the April 26, 2024 in IT & Programming

About this project

Open

I need to test that setup. Somebody could  to help me ?

Host the airflow on an EC2.
● Develop a job that filters the Athena data sample, where it should be extracted
two columns, one column containing the name of the operating system, the second
column containing the count of how many times that operating system appears.
● This data must be stored in S3 in CSV format.
● EC2 and S3 must be provisioned using Terraform.
● Bonus: Terraform ci/cd mat (optional).
● Creation of 3 types of Airflow user, first must be Admin (Full Access),
according to the Write User (Permission to create and trigger Dags) and the Read User (Only
view).
● You must create a new Dag, and within this Dag there must be the Job responsible
by filtering the data.
● Job must run every day at midnight, except on weekends (Saturday and
Sunday).

Project overview

I need to test that setup. The project must is done at next Monday.

Category IT & Programming
Subcategory Web development
What is the scope of the project? Small change or bug
Is this a project or a position? Project
I currently have I have specifications
Required availability As needed
Roles needed Developer

Delivery term: April 29, 2024

Skills needed

Linux Python Terraform Amazon AWS AI/ML

Want to start working on this project?

Log into your Workana account or Register today. Boost your freelance work!