Data Engineer

Roles and Responsibilities

monitoring, creation, and maintenance of the RAFI MFI MIS

reports to the management and provide insights through a data-driven business approach

craft data models for the RAFI MFI

responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection

Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

Experience building and optimizing ?big data? data pipelines, architectures and data sets.

Skill sets:
Experience with big data tools:
Hadoop,

Spark, Kafka, etc.Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.

Experience with data pipeline and workflow management tools:
Azkaban, Luigi, Airflow, etc.

Experience with Azure cloud services:
Data Warehouse, Data Factory, Cosmo Databases, Azure Databases

Experience with stream-processing systems:
Storm, Spark-Streaming, etc.

Experience with object-oriented/object function scripting languages:
Python, Java, C++, Scala, etc.

Qualifications

Graduate of Computer Science, Information Technology, Computer Engineering or its equivalent

With at least 4 years solid experience in systems and data administration

Preferably with any Information Technology related certification