Expert, Data Platforms Engineer

Job Descriptions

Job Title: _ Expert, Data Engineer - Data Platforms

Responsibilities

What will you do?

Join Schneider Electric and help us power a sustainable future through data.

As a Data Engineer within our Data Platforms organization, you'll play a critical role in designing and delivering advanced data solutions that enable trusted analytics and AI across the enterprise.

You will collaborate with business stakeholders, solution architects, and global technology teams to create efficient, scalable data flows while ensuring strong data governance practices.

Your expertise will help transform raw data into actionable insights that drive innovation and smarter decisions for our customers and the planet.


* Design, develop and engineer data lake by data source identification, data extraction, data modelling, data store design and governance


* Develop data flows to ingest and transform both structured and unstructured data using warehousing and big data methodologies and tools to build refined and aggregated data assets for business intelligence and AI enablement.


* Implement efficient patterns for data storage, partitioning, semantic layer and metadata structures to enable consumption of data as a product.


* Implement automation capabilities to enable governance features for data privacy and protection, data inventory and cataloguing, authorization and data security.


* Implement enhanced observability, cost management and reporting strategies for data engineering operations.


* Build relevant integration testing and quality assurance capabilities while ensuring compliance with architectural standards for development.


* Perform assessments (Proof of Concepts) of the latest tools and technology to solution and assist in evolving the technology landscape.


* Lead, mentor, and support the Data Delivery teams with methodologies, tools and technical knowledge.

What skills and capabilities will make you successful?


* 3+ years of Hands-on experience in AWS services including but not limited to: S3, KMS, Lambda, Glue (or Spark), SQS, EventBridge, AWS Step functions etc.,


* 3+ years of hand on experience in writing clean, modular, testable, and maintainable code using either functional or OOP principles.


* Good understanding of AWS networking concepts: VPC, subnets, routing, NAT gateways, security groups.


* Proficiency in IAM concepts: roles, policies, assume-role, and cross-account access.


* Good experience in at least one programming language such as Python, Scala, Java etc


* Good understanding of Spark architecture, execution plans, and performance tuning.


* Strong SQL skills (complex joins, window functions, aggregations etc) and experience with Redshift and/or Athena, or any other distributed compute engines.


* Experience in writing and maintaining Terraform scripts.


* Familiarity with Git, GitHub workflows, and CI/CD tools like Jenkins.


* Hands on experien...