ViewJobs
Listed 9 weeks ago

Big Data Engineer

Pyramid Global Technologies

Developers/Programmers
Location
New South Wales
Type
Full-time

About the role

Job Description for Big Data Engineer:

Primary Skills- Bigdata Hadoop, Hive, Spark, scala, SQL

Secondary Skills- DW/ETL, Unix, Git, Bitbucket, ControlM

- 3-5 years of experience in developing end to end bigdata pipeline

- Must have experience in developing at least 1 bigdata project using hive, spark, scala

- Thorough understanding of Hadoop and spark architecture

- Strong SQL skills

- Basic understanding of Unix scripting

- Good understanding of Data warehouse/ETL concepts

- Experience on any version control tool

- Experience on any job scheduling tool

- Good to have knowledge on Azure or any other cloud

- Good to have experience on Hive Query or spark code optimization

Apply

via careers-page.com

Similar jobs

  • 9 weeks ago

    Big Data Engineer

    Pyramid Global Technologies

    Job Description: · 5+ years experience working in Data Engineering and Warehousing. · 3 -5 years’ experience integrating data into analytical platforms · Experience in ingestion technologies (e.g. Sqoop, flume), proce…

    New South Wales
    Full-time
    Listed 9 weeks ago
    Database Development & Administration
    Apply
  • 9 weeks ago

    Big Data Engineer

    Pyramid Global Technologies

    Job Description: · 5+ years experience working in Data Engineering and Warehousing. · 3 -5 years’ experience integrating data into analytical platforms · Experience in ingestion technologies (e.g. Swoop, flume), proce…

    New South Wales
    Full-time
    Listed 9 weeks ago
    Database Development & Administration
    Apply
  • 8 weeks ago

    Senior Data Engineer

    PayTech Nexus

    12 month contract opportunity Start - ASAP Location - Sydney (hybrid) Opportunity to work with one of the largest and most advanced Data Engineering teams in the country As a Senior Data engineer with expertise in sof…

    Sydney, NSW
    Full-time
    Listed 8 weeks ago
    B2B
    Apply
  • 8 weeks ago

    Senior Data Engineer

    XPT Software Australia Pty

    Minimum Years of Experience: 8Years Must Have Skills: · Hands On with advanced SQL, Python etc. · Hands On in data profiling · Hands On in working on Cloud like Azure and Cloud DW like Data bricks · Hands On experienc…

    Sydney, NSW
    Full-time
    Listed 8 weeks ago
    IT
    Apply
  • 9 weeks ago

    Teradata Developer

    Pyramid Global Technologies

    Job Description: · 5+ years’ experience working in Data Engineering and Warehousing. · 3 -5 years’ experience integrating data into analytical platforms · Experience in ingestion technologies (e.g. Sqoop, flume), proc…

    New South Wales
    Full-time
    Listed 9 weeks ago
    Database Development & Administration
    Apply
  • 8 days ago

    Senior Data Engineer

    Peoplebank

    This role opportunity exists for an experienced Spark & Scala Data Engineer to join a secure enterprise environment supporting critical infrastructure. Location: Melbourne, Adelaide, Brisbane, Sydney, Canberra Work Ty…

    Adelaide, SA
    Full-time
    Listed 8 days ago
    Developers/Programmers
    Apply