Software Engineer III - LLM

We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.

As a Software Engineer III at JPMorgan Chase within Corporate Sector - AIML Data Platforms LLM Team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way.

You will play a crucial role in the LLM Suite within the AMDP team, tackling some of the most pressing challenges in the financial services sector to create meaningful impact for the organization.

Your responsibilities will include transforming early-stage code into production-ready solutions.

Job responsibilities


* Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems


* Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems


* Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development


* Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems


* Develop innovative AI/ML solutions and agentic systems for the LLM Suite platform utilizing public cloud architecture and modern standards, specifically with Azure, AWS, and AI Agentic frameworks


* Develop and implement state-of-the-art GenAI services leveraging Azure OpenAI models and AWS Bedrock service.


* Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture


* Contributes to software engineering communities of practice and events that explore new and emerging technologies


* Adds to team culture of diversity, inclusion, and respect

Required qualifications, capabilities and skills


* Formal training or certification on software engineering concepts and 3+ years applied experience


* Hands-on practical experience in system design, application development, testing, and operational stability


* Proficient in coding in one or more languages including Python (fastAPI), Microservices, API, LLM, and AWS (EC2, ECS, EKS, Lambda, SQS, SNS, RDS Aurora MySQL & Postgres, DynamoDB, EMR, and Kinesis)


* Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages


* Overall knowledge of the Software Development Life Cycle


* Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and Security


* Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, ma...