Intermediate or Senior AWS Data Engineer

Job Description

A technology and business consulting firm seeks an AWS Data Engineer with expertise in building scalable data pipelines on AWS. The role involves designing and implementing cloud-based data solutions for financial institutions using Python or C#, AWS Glue (PySpark), and ETL systems.

Requirements

• Proficiency in SQL and data modelling principles
• Deep experience with AWS services including Glue, Lambda, S3, RDS, Redshift, DynamoDB, Kinesis, SQS/SNS, IAM
• Experience with CI/CD, DevOps, and scripting (PowerShell, Bash, Python, etc.)
• Familiarity with RDBMS systems such as PostgreSQL, MySQL, SQL Server
• Agile/Scrum methodology and full SDLC experience
• Experience with Kafka and real-time data ingestion is advantageous
• Strong Python or C# programming skills including OOP and data engineering libraries

Responsibilities

• Design, build, and optimize robust data pipelines and architectures on AWS
• Lead implementation of scalable and secure data solutions
• Ingest data into AWS S3 and transform/load into RDS/Redshift
• Build AWS Glue Jobs using PySpark or Glue Spark
• Use AWS Lambda (Python/C#) for event-driven data transformation
• Collaborate on migration and deployment automation from development to production
• Support data governance, lineage, and security best practices
• Deliver data insights through well-structured models and pipelines
• Work with batch, real-time (Kafka), and streaming architectures
• Interact with stakeholders and communicate technical concepts clearly