09th April, 2025
Our client in Rochester, NY, is looking to hire a remote Data Processing Engineer.
This is a fully-remote/part-time/3-month contract position
Hourly range based on experience: $50-$55/HR
Primary Responsibilities: - Implement AWS SNS topic as GCP PubSub equivalent
- Convert Apache Beam configurations to AWS Managed Flink for ~16 jobs
- Integrate AWS Managed Flink with AWS Glue
- Configure Glue Data Catalog for processed data storage
- Set up and configure AWS Managed Airflow
- Migrate workflows from Google Composer to AWS MWAA
- Assist with testing and documentation of data processing components
- Support AWS Marketplace integration for data processing aspects
Required AWS Service Skills: - AWS Managed Flink
- AWS SNS
- AWS Glu
- AWS MWAA (Managed Airflow)
- AWS Lambda
- Amazon CloudWatch
- AWS IAM
Required Technical Skills: - Python (advanced)
- Terraform
- Apache Beam
- Apache Airflow
- ETL Pipeline Development
- Data Processing
- Streaming Data Architecture
Required Soft Skills: - Problem-solving
- Team Collaboration
- Technical Documentation
- Communication Adaptability
Applicants must be authorized to work in the U.S.
We are an equal-opportunity employer. We do not discriminate in hiring or employment against any individual based on race, color, gender, national origin, ancestry, religion, physical or mental disability, age, veteran status, sexual orientation, gender identity or expression, marital status, pregnancy, citizenship, or any other factor protected by anti-discrimination laws.
Apply For Job