Lead data engineer

Your Job

The lead data engineer will be a part of a global team that architects, designs, develops, and delivers data pipeline solutions leveraging the latest technology stacks of data engineering technologies for Koch Industries.

Koch Industries is a privately held global organization with over 120,000 employees around the world, with subsidiaries involved in manufacturing, trading, and investments.

Koch global services India (KGSI) is being developed in India to extend its IT operations, as well as act as a hub for innovation in the IT function.

as well as improving existing solutions for Georgia Pacific.

This position will be responsible for creating and enhancing data pipelines for procurement data delivery team.

This position will also be responsible for providing support for mission critical data applications and bug fixes.

Our Team

We are seeking a Lead Data Engineer who will be responsible to take a lead in architecture, developing and implementing a future-state data analytics platform for both the back-end data processing and the front-end data visualization component for the Finance Data Delivery teams.

This will be a hands-on role to build ingestion pipelines and the Datawarehouse.

What You Will Do


* Ability to scale up, lead, propose better architecture, present solutions and take care of delivery.


* Hands-on experience with AWS technologies and at least one full life cycle project experience using various cloud technologies (Redshift, Lambda, Step functions, RDS, event bridge)


* Hands-on expertise with writing, modifying, tuning SQL queries and stored procedures.


* Well architect the solution to optimize, scale and perform performance tuning on DW on AWS Redshift and the data lake on AWS S3


* Analyze, design, development, testing, and support of Talend DI/ Big Data solution.


* Expert in backtracking, troubleshooting failures and provide fix for production issues.


* On demand support data feeds from various ERP source systems into Data warehouse


* Proactively identify gaps and propose better/best possible solutions to the existing system.


* Ability to independently work on full life cycle projects.


* Expert analysis of large complex data sets to resolve data quality issues and propose permanent fix.


* Translate the functional requirements into technical specification and assist team.


* Lead the design and development of data pipeline along with ensuring delivery.


* Be able to adopt to technical stack used by Procurement Data Lake and Data Warehouse


* Position's day to day responsibility will be directed by the technical lead who is part of the KGSI / GP.

All team members are required to be on a daily status call with GP Technical Lead.

Who You Are (Basic Qualifications)

• Bachelor's/master's degree in computer science/information technology with 5 to 8 years of overall IT experience.

• 6+ years of data engineering experience, Data Modelling, Data Lake...