Data Engineer

We are looking for an experienced Data Engineer to join a team focused on building and supporting scalable, cloud-native data platforms.
What you’ll be doingDesign, develop and support cloud-native data platforms and data pipelines.Build and maintain ETL/ELT pipelines using AWS services.Work extensively with SQL, Python and Spark/PySpark for data processing and transformation.Develop solutions using AWS S3, Glue, EMR, Athena and Aurora PostgreSQL.Apply data modelling and database design principles to support scalable data solutions.Work with Change Data Capture (CDC) and operational databases.Contribute to data governance, monitoring and CI/CD processes.Work with GitHub Actions to support automated deployments and delivery.Collaborate with stakeholders and delivery teams in an Agile environment.Troubleshoot data pipeline and platform issues and contribute to continuous improvement.
What we’re looking forStrong commercial experience as a Data Engineer.Hands-on expertise in SQL and Python.Strong experience with AWS, particularly S3, Glue, EMR, Athena and Aurora PostgreSQL.Solid experience developing ETL/ELT data pipelines.Strong knowledge of data modelling.Hands-on experience with Spark/PySpark.Experience with CDC, data governance, CI/CD and monitoring.Experience working with operational databases.Strong problem-solving and stakeholder engagement skills.Experience working in Agile delivery environments.
Nice to haveKafka / Amazon MSKTerraformEvent-driven architecturesSnowflakedbt
If this sounds like you, apply now or contact Anupama Cavuturi on 0486 199 174 for a confidential discussion.