Data Engineer (Databricks)

Details of the offer

Have you ever envisioned a world where data seamlessly transforms into insights, propelling businesses forward? Imagine being at the forefront of this data-driven revolution, crafting sophisticated data pipelines and harnessing the power of visualizations. Join us, where your passion for data engineering meets limitless possibilities!

About Sharesource: We are a social enterprise dedicated to connecting global opportunities with talented individuals. Currently, we serve Australian clients and aim to empower businesses to thrive by accessing the talent they need worldwide. Our mission is to support individuals in achieving success in their careers while fostering a company culture that embodies our values.

What are we looking for?
We are in search of a dynamic Data Engineer, passionate about leveraging technology to deliver exceptional value to customers. As a crucial part of our team, you'll be responsible for designing and implementing data pipelines, ensuring high-quality data integration, and contributing to innovative solutions.

What are you expected to do? Design and implement data pipelines for extracting and loading data into a central data store. Collaborate with stakeholders to understand business requirements and design data models. Optimise and enhance existing data pipelines for high performance and reliability. Develop and maintain data quality checks to ensure accuracy and completeness. Monitor and maintain data pipelines, identifying areas for improvement. Participate in code reviews and collaborate with other engineers to maintain high-quality code. Create visualisations using tools like Power BI. Stay updated with industry trends, recommending new tools and technologies for data infrastructure improvement. Participate in discovery workshops and solutions design activities with customers. You'll be a great fit if: You have at least 5 years of related experience. You have strong experience with Databricks, Snowflake, Redshift, or Synapse. You demonstrate proficiency in AWS and/or Azure. You possess extensive knowledge of ETL processes and data integration. You showcase expertise in data warehousing, modelling, and lake house architecture. You possess strong programming skills in Python, SQL, and Spark. You excel in communication and collaboration. You have hands-on experience with Python (Pyspark, Lambda, Batch, Glue, DataFlow, etc). You work with customers to elicit requirements and scope projects. You demonstrate proficiency in data transformation and migration. You understand Data Governance concepts (MDM, Metadata management, Data Security, Data Quality, etc). You continuously monitor and maintain data pipelines, ensuring they run smoothly and identifying areas for improvement. We will be absolutely thrilled if you also have the following: You possess visualization skills with an eye for aesthetics. You demonstrate descriptive Data Analytics skills with PowerBI. You have experience in Data Lake establishment and/or data pipeline development. Your dashboard proficiency includes Tableau, Kibana, Quicksight, PowerBI. You are familiar with commercial ETL tools like DBT, Talend, Informatica, or Attunity. You have exposure to Infrastructure as code and cloud deployment. You are familiar with Bitbucket, GitHub, Azure DevOps. Here are the benefits of joining our team: Competitive salary and professional development. Collaborative client partnerships and a fun, inclusive work environment. Opportunities for leadership, expertise, and global client exposure. Monthly coaching, training, and career development. Remote work flexibility and a flexible hybrid model. Engage in social impact activities and industry impact. Achieve work-life balance and flexibility to support personal commitments. Comprehensive HMO coverage with one free dependent. What happens after you submit your application? The whole process takes around 4 weeks:

There will be 3-4 interviews and a possible assessment from our client partner. You will undergo an initial interview, a culture interview, and 1-2 interviews with our client. Be yourself and have fun. We will constantly communicate with you as to the development of your application. You can also directly communicate with us to ask about the status of your application. If all goes well, we complete the reference check and provide other necessary requirements so we can offer you the job right away. At Sharesource, we believe in the value of diversity and inclusion. We are committed to creating a diverse, respectful, and inclusive workplace, and we do not discriminate based on factors such as race, gender, religion, sexual orientation, or disability.

#J-18808-Ljbffr


Nominal Salary: To be agreed

Source: Grabsjobs_Co

Requirements

Application Security Manager

MINIMUM REQUIREMENTSEDUCATION :Bachelor's Degree in computer science, engineering, or relevant field.EXPERIENCE :At least 5 years of experience in informatio...


Dempsey Resource Management Inc. - National Capital Region

Published 19 days ago

Devops Engineers (Hybrid)

Qualifications: Bachelor's or Masters' degree in computer science or equivalent is required.5+ years minimum hands-on experience with cloud platforms4+ years...


Hunter'S Hub, Inc. - National Capital Region

Published 19 days ago

Ax12 Erp Application Specialist (Hybrid)

Job Summary: The ERP Application Specialist (AX12) will be responsible for the administration, maintenance, and optimization of the AX12 ERP system. This ro...


Blaseek - National Capital Region

Published 19 days ago

L3 Network Engineer (Dayshift) - Makati City

Scope of Work: L3 Network Engineer Deployment and connectivity of Internet link at Site in coordination with ISP Software Upgrade, Installation and initial ...


Strategic Networks Inc. - National Capital Region

Published 19 days ago

Built at: 2024-11-24T02:38:59.221Z