ViewJobs
Listed 9 weeks ago

Big Data Engineer

Pyramid Global Technologies

Database Development & Administration
Location
New South Wales
Type
Full-time

About the role

Job Description:

· 5+ years experience working in Data Engineering and Warehousing.

· 3 -5 years’ experience integrating data into analytical platforms

· Experience in ingestion technologies (e.g. Sqoop, flume), processing technologies (Spark/Scala), and storage (e.g. HDFS, HBase, Hive)

· Experience in data profiling, source-target mappings, ETL development, SQL optimization, testing, and implementation

· Expertise in streaming frameworks (Kafka/Spark Streaming/Storm) essential

· Experience in building Spark Sql and Spark Data Frame API-based applications.

· Experience managing structured and unstructured data types

· Experience in requirements engineering, solution architecture, design, and development/deployment

· Experience in creating big data or analytics IT solution

· Track record of implementing databases and data access middleware and high-volume batch and (near) real-time processing

Apply

via careers-page.com

Similar jobs

  • 9 weeks ago

    Big Data Engineer

    Pyramid Global Technologies

    Job Description: · 5+ years experience working in Data Engineering and Warehousing. · 3 -5 years’ experience integrating data into analytical platforms · Experience in ingestion technologies (e.g. Swoop, flume), proce…

    New South Wales
    Full-time
    Listed 9 weeks ago
    Database Development & Administration
    Apply
  • 9 weeks ago

    Big Data Engineer

    Pyramid Global Technologies

    Job Description for Big Data Engineer: Primary Skills- Bigdata Hadoop, Hive, Spark, scala, SQL Secondary Skills- DW/ETL, Unix, Git, Bitbucket, ControlM - 3-5 years of experience in developing end to end bigdata pipeli…

    New South Wales
    Full-time
    Listed 9 weeks ago
    Developers/Programmers
    Apply
  • 9 weeks ago

    Teradata Developer

    Pyramid Global Technologies

    Job Description: · 5+ years’ experience working in Data Engineering and Warehousing. · 3 -5 years’ experience integrating data into analytical platforms · Experience in ingestion technologies (e.g. Sqoop, flume), proc…

    New South Wales
    Full-time
    Listed 9 weeks ago
    Database Development & Administration
    Apply
  • 8 weeks ago

    Senior Data Engineer

    PayTech Nexus

    12 month contract opportunity Start - ASAP Location - Sydney (hybrid) Opportunity to work with one of the largest and most advanced Data Engineering teams in the country As a Senior Data engineer with expertise in sof…

    Sydney, NSW
    Full-time
    Listed 8 weeks ago
    B2B
    Apply
  • 8 weeks ago

    Senior Data Engineer

    Ippon Technologies

    Ippon Australia is a team of true technologists who leverage contemporary thinking and tools to enhance the way our clients drive value. Whether it’s a bespoke platform to improve employee engagement within a national…

    Melbourne, VIC
    Full-time
    Listed 8 weeks ago
    Apply
  • 8 weeks ago

    Data Engineer

    Nuvento

    Who we are and how are we different? Nuvento is a Canberra-based specialist technical data consultancy that provides consultancy services to both private and public organizations throughout Australia. Our team consist…

    Canberra, ACT
    Full-time
    Listed 8 weeks ago
    Apply