AWS Data Engineer

Job Description

Join IQbusiness in Cape Town as an AWS Data Engineer, where you’ll leverage your expertise to craft scalable and secure data solutions for a leading management consulting firm. Collaborate with cross-functional teams to develop innovative data pipelines, harnessing AWS and Big Data technologies to drive actionable insights. This role offers a dynamic opportunity to contribute to cutting-edge projects in a hybrid work environment, aligning with IQbusiness’s 20-year legacy of delivering impactful solutions across South Africa and beyond.

Requirements

• Proven record as an AWS Cloud Data Engineer with expertise in creating scalable and secure data solutions
• Proficiency in AWS and Big Data technologies such as AWS EC2, AWS S3, AWS Lambda, and Spark/SparkSQL
• Adeptness with programming languages like Java, C#, Node.js, Python, and SQL
• Comprehension of cloud-based infrastructure and DevOps tools
• Familiarity with data integration, enterprise data warehousing, and data visualization

Responsibilities

• Develop data ingestion, data processing, data engineering, and analytical pipelines for big data, relational databases, NoSQL, and data warehouse solutions
• Utilize public cloud architectures, considering pros/cons and migration considerations
• Implement AWS and Big Data technologies such as AWS EC2, AWS S3, AWS Lambda, Spark/SparkSQL, and streaming technologies like Apache Kafka, AWS Kinesis, and Apache NiFI
• Use programming languages such as Java, C#, Node.js, Python, PySpark, SQL, and Unix shell/Perl scripting
• Work with DevOps tools like GitHub, GitLab, Jenkins, CodeBuild, CodePipeline, and CodeDeploy
• Follow Agile software development and DevOps best practices and principles