Software Engineer III - Data Engineer/PySpark/Databricks

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.

As a Software Engineer III at JPMorganChase within the ENTERPRISE TECHNOLOGY(EMPLOYEE DIGITAL AND SERVICE EXP) , you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way.

You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.

Job responsibilities



* Execute creative software and data solutions, including design, development, and technical troubleshooting, by thinking beyond routine approaches to build solutions or break down technical problems.


* Develop secure, high-quality production code and data pipelines, reviewing and debugging processes implemented by others.


* Identify opportunities to eliminate or automate remediation of recurring issues to improve operational stability of software applications and systems.


* Lead evaluation sessions with external vendors, startups, and internal teams to drive outcomes-oriented probing of architectural designs and technical credentials.


* Work with business stakeholders to understand requirements and design appropriate solutions, producing architecture and design artifacts for complex applications.


* Implement robust monitoring and alerting systems to proactively identify and address data ingestion issues, optimizing performance and throughput.


* Implement data quality checks and validation processes to ensure accuracy and reliability of data.


* Design and implement scalable data frameworks to manage end-to-end data pipelines for workforce data analytics.


* Share and develop best practices with Platform and Architecture teams to improve data pipeline framework and modernize the workforce data analytics platform.


* Gather, analyze, and synthesize large, diverse data sets to continuously improve capabilities and user experiences, leveraging data-driven insights.


* Contribute to software engineering communities of practice and events that explore new and emerging technologies, fostering a culture of diversity, opportunity, inclusion, and respect.

Required qualifications, capabilities, and skills



* Formal training or certification in software engineering concepts with 5+ years of applied experience and 7+ years in data engineering, including design, application development, testing, and operational stability.


* Advanced proficiency in data processing frameworks and tools, including Parquet, Iceberg, PySpark, Glue, Lambda, Databricks, and AWS data services like EMR, Athena, and Redshift.


* Proficiency in programming languages like Python, Java, or Scala for data processing and application development.


* Proficiency in automation and continuous delivery methods, utilizing CI/CD pipelines with tools like ...