Lead Software Engineer - AWS/PySpark/Data Engineer/Databricks

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

As a Lead Software Engineer at JPMorgan Chase within the Corporate Technology Employee Platform team, you play a vital role in an agile team dedicated to enhancing, building, and delivering trusted, market-leading technology products in a secure, stable, and scalable manner.

As a key technical contributor, you are tasked with implementing critical technology solutions across multiple technical domains, supporting various business functions to achieve the firm's business objectives.

Job responsibilities


* Execute creative software and data solutions, including design, development, and technical troubleshooting, by thinking beyond routine approaches to build solutions or break down technical problems.


* Develop secure, high-quality production code and data pipelines, reviewing and debugging processes implemented by others.


* Identify opportunities to eliminate or automate remediation of recurring issues to improve operational stability of software applications and systems.


* Lead evaluation sessions with external vendors, startups, and internal teams to drive outcomes-oriented probing of architectural designs and technical credentials.


* Work with business stakeholders to understand requirements and design appropriate solutions, producing architecture and design artifacts for complex applications.


* Implement robust monitoring and alerting systems to proactively identify and address data ingestion issues, optimizing performance and throughput.


* Implement data quality checks and validation processes to ensure accuracy and reliability of data.


* Design and implement scalable data frameworks to manage end-to-end data pipelines for workforce data analytics.


* Share and develop best practices with Platform and Architecture teams to improve data pipeline framework and modernize the workforce data analytics platform.


* Gather, analyze, and synthesize large, diverse data sets to continuously improve capabilities and user experiences, leveraging data-driven insights.


* Contribute to software engineering communities of practice and events that explore new and emerging technologies, fostering a culture of diversity, opportunity, inclusion, and respect.

Required qualifications, capabilities, and skills


* Formal training or certification on software engineering concepts and 5+ years applied experience


* 7+ years in data engineering, including design, application development, testing, and operational stability.


* Advanced proficiency in data processing frameworks and tools, including Parquet, Iceberg, PySpark, Glue, Lambda, Databricks, and AWS data services like EMR, Athena, and Redshift.


* Proficiency in programming languages like Python, Java, or Scala for data processing and application development.


* Proficiency in automation and continuous delivery metho...