Software Engineer [Multiple Positions Available]

DESCRIPTION:

Duties: Execute software solutions, including design, development, and technical troubleshooting, by breaking down technical problems.

Create secure and high-quality production code and maintain algorithms that run synchronously with related or dependent systems.

Work with business stakeholders to understand business requirements and design appropriate solutions.

Produce architecture and design artifacts for complex applications, ensuring design constraints are met by software code development.

Identify and resolve bottlenecks in data ingestion processes, optimizing performance and throughput.

Implement robust monitoring and alerting systems to proactively identify and address data ingestion issues.

Implement data quality checks and validation processes to ensure the accuracy and reliability of data.

Design and implement scalable data frameworks to manage end-to-end data pipelines, ensuring secure and efficient processing for our workforce data analytics platform.

Interpret functional specifications, create technical specifications and deliver quality code to specification.

Share and develop best practices along with Platform and Architecture teams to help improve our data pipeline framework and involve in modernization of our work force data analytics platform.

Gather, analyze, and synthesize large, diverse data sets to continuously improve capabilities and user experiences, leveraging data-driven insights.

Proactively identify hidden problems and patterns in data, using insights to drive improvements in coding hygiene and system architecture.

Contribute to software engineering communities of practice and events that explore new and emerging technologies.

QUALIFICATIONS:

Minimum education and experience required: Bachelor's degree in Electronic Engineering, Computer Science, Computer Engineering, or related field of study plus 5 years of experience in the job offered or as Software Engineer, Software Developer, IT Consultant, Project Engineer, or related occupation.

The employer will alternatively accept a Master's degree in Electronic Engineering, Computer Science, Computer Engineering, or related field of study plus 3 years of experience in the job offered or as Software Engineer, Software Developer, IT Consultant, Project Engineer, or related occupation.

Skills Required: This position requires experience with the following: utilizing AWS data services such as Glue for serverless ETL processes, EMR for large scale data processing, Athena for interactive query analysis, or Redshift for data warehousing and analytics; utilizing Apache Spark for large-scale data processing; using Spark SQL to perform complex queries on structured data, leveraging its DataFrame API for seamless integration with various data sources and high-performance analytics; managing cloud services deployment using Terraform; integrating data platforms through CI/CD pipelines with tools such as Git, Bitbucket, Jenkins, or Spinnaker for automated deployment...