Software Engineer III - Databricks, Spark

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.

As a Software Engineer III at JPMorgan Chase within the Corporate Sector, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way.

You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.

Job responsibilities



* Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems


* Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems


* Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development


* Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems


* Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture


* Contributes to software engineering communities of practice and events that explore new and emerging technologies


* Provides guidance to immediate team of software engineers on daily tasks and activities


* Sets the overall guidance and expectations for team output, practices, and collaboration


* Anticipates dependencies with other teams to deliver products and applications in line with business requirements


* Manages stakeholder relationships and the team's work in accordance with compliance standards, service level agreements, and business requirements


* Creates a culture of diversity, equity, inclusion, and respect for the team members and prioritizes diverse representation

Required qualifications, capabilities, and skills



* Formal training or certification on software engineering concepts and 3+ years applied experience


* Hands on experience in data mapping, data architecture, and data modeling on Databricks


* Extensive experience in AWS, Design, implementation, and maintenance of data pipelines using Python, pyspark on Databricks


* Proficient in Python, and PySpark, able to write and execute complex queries to perform curation and build views required by end users (single and multi-dimensional)


* Extensive experience in Databricks Data engineering (Job Runs, Data Ingestion and Delta Live Tables, Spark Streaming)


* Experienced in standing up and maintaining EC2 instances, Kubernetes clusters and Lambda services


* Experience in building Notebooks with complex code structures and debugging failed jobs.


* Proven exp...