Data Engineer

We are seeking a highly skilled Data Engineer with 5 to 8 years of experience to join our Data Management team.

The candidate must have extensive experience in Azure technologies and sophisticated Python skills.

Experience with Oracle technologies would be an added advantage.

This role involves crafting, building, and optimizing data pipelines, ensuring data security, and enabling analytical capabilities across the organization.

IN THIS ROLE, YOUR RESPONSIBILITIES WILL BE: 


* Develop, test, and maintain high-quality software products by using ground breaking technologies and best programming practices.


* Design, develop, and maintain scalable and high-performance data pipelines using Azure Data Factory, Azure Synapse Analytics, and other Azure services.


* Develop and maintain ETL/ELT processes to ensure the quality, consistency, and accuracy of data.


* Implement data integration solutions across on-premise, hybrid, and cloud environments.


* Ensure the security, availability, and performance of enterprise data platforms.


* Work with relational (SQL Server, Azure SQL) and non-relational databases (Azure Cosmos DB, etc.).


* Build, test, and deploy data solutions using Azure DevOps, version control, and CI/CD pipelines.


* Develop and implement data governance policies and practices to ensure data integrity and security.


* Perform code reviews and ensure the quality of work from the other developers are as per the standards.


* Collaborate with multi-functional teams, including designers, developers, and quality assurance engineers to build, refine, and improve software products.


* Optimize and solve large datasets using Python and Azure cloud-native technologies.


* Build and maintain comprehensive user documentation.
 

WHO YOU ARE: A competent professional characterized by having a strong instinct to act, consistently pursuing self-development to enhance skills and knowledge.

You possess a drive for achieving results, demonstrating a commitment to perfection in their endeavors.

Tech-savvy professional adept at demonstrating technological tools to streamline processes and enhance productivity.

You excel in collaborative efforts, recognizing the value of collaboration and optimally contributing to collective goals. 
 

FOR THIS ROLE, YOU WILL NEED: 


* Bachelor’s degree in computer science or a related field


* 5+ years of experience as a Data Engineer, focusing on Azure cloud services with a Solid understanding of Python/PySpark programming language. 


* Strong hands-on experience with Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, and Azure Storage.


* Experience with Azure Databricks and PySpark is highly desirable


* Strong SQL skills, including experience with data modeling, sophisticated queries, and performance optimization.


* Expertise in Delta Tables and Delta live tables 


* Familiarity with version control systems (e...