ViewJobs
Listed 8 days ago

Senior Data Engineer

Peoplebank

Developers/Programmers
Location
Adelaide, SA
Type
Full-time

About the role

This role opportunity exists for an experienced Spark & Scala Data Engineer to join a secure enterprise environment supporting critical infrastructure.

Location: Melbourne, Adelaide, Brisbane, Sydney, Canberra
Work Type: 
1x day per fortnight onsite
Tenure: 
rolling 3x month contracts


Key Responsibilities: 
  • Design and develop scalable data pipelines using Spark and Scala.
  • Build and support batch and real-time data processing solutions.
  • Analyse requirements and provide fit-for-purpose technical designs.
  • Develop APIs, data services and reusable engineering frameworks.
  • Deliver high-quality, well-tested code and perform code reviews.
  • Support CI/CD, automation and production operations.
  • Collaborate with stakeholders to deliver projects on time and within budget.
  • Mentor junior engineers and contribute to continuous improvement.

Key Skills: 

  • Extensive experience in Data Engineering or Big Data development.
  • Strong hands-on experience with Scala, Java and Apache Spark.
  • Experience building real-time and batch data pipelines.
  • Strong knowledge of Kafka, Hive, HBase, HDFS and the Hadoop ecosystem.
  • Experience designing and supporting large-scale Big Data platforms.
  • Strong SQL and data analysis skills.
  • Experience with CI/CD, automated testing and Agile delivery.
  • Strong communication and stakeholder management skills.



Peoplebank and Leaders IT are committed to creating a diverse and inclusive workplace where everyone belongs. We welcome applications from people of all backgrounds, identities, and experiences. If you need adjustments to the recruitment process due to your circumstances, please let us know—we’re here to support you.
Apply

via peoplebank.com.au

Similar jobs

  • 8 days ago

    Senior Data Engineer

    Peoplebank

    This role opportunity exists for an experienced Spark & Scala Data Engineer to join a secure enterprise environment supporting critical infrastructure. Location: Melbourne, Adelaide, Brisbane, Sydney, Canberra Work Ty…

    Melbourne, VIC
    Full-time
    Listed 8 days ago
    Developers/Programmers
  • 8 weeks ago

    Senior Data Engineer

    PayTech Nexus

    12 month contract opportunity Start - ASAP Location - Sydney (hybrid) Opportunity to work with one of the largest and most advanced Data Engineering teams in the country As a Senior Data engineer with expertise in sof…

    Sydney, NSW
    Full-time
    Listed 8 weeks ago
    B2B
  • 8 weeks ago

    Data Engineer with using Apache Spark, Python, Scala.

    Tech Aalto

    Data Engineer with using Apache Spark, Python, Scala. Location: Melbourne Position Type: Contract Data Engineer As a Data Engineer, you will be responsible for designing, developing, and maintaining robust data infras…

    Melbourne, VIC
    Full-time
    Listed 8 weeks ago
  • 8 weeks ago

    Data Engineer

    Nuvento

    Who we are and how are we different? Nuvento is a Canberra-based specialist technical data consultancy that provides consultancy services to both private and public organizations throughout Australia. Our team consist…

    Canberra, ACT
    Full-time
    Listed 8 weeks ago
  • 8 weeks ago

    Senior Data Engineer

    Equal Experts

    Description Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on import…

    Sydney, NSW
    Full-time
    Listed 8 weeks ago
  • 2 weeks ago

    Senior Data Engineer

    Leaders

    Senior Data Engineer Permanent position Build scalable data platforms with Databricks Lead the implementation of a modern enterprise data platform We are seeking an experienced Senior Data Engineer to join a growing d…

    Destination Perth, WA
    Full-time
    Listed 2 weeks ago
    Database Development & Administration