Data Engineer
We are looking for a savvy Data Engineer to join our growing team of analytics experts.
The hire will be responsible for expanding and optimizing our data pipeline architecture.
The ideal candidate is an experienced data pipeline builder and data wrangler with strong experience in handling data at scale.
The Data Engineer will support our software developers, data analysts and data scientists on various data initiatives.
This is a role that can be based in our Jersey City, NJ location (hybrid) or that can be done fully remote in the continental US (some locations not supported); work is on Eastern time zone hours.
Why this role
This is a highly visible role within the enterprise data lake team.
Working within our Data group and business analysts, you will be responsible for leading creation of data architecture that produces our data assets to enable our data platform.
This role requires working closely with business leaders, architects, engineers, data scientists and wide range of stakeholders throughout the organization to build and execute our strategic data architecture vision.
* Extensive understanding of SQL queries.
Ability to fine tune queries based on various RDBMS performance parameters such as indexes, partitioning, Explain plans and cost optimizers.
* Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS technologies stack
* Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
* Working with data scientists and industry leaders to understand data needs and design appropriate data models.
* Participate in the design and development of the AWS-based data platform and data analytics.
Skills Needed
* Design and implement data ETL frameworks for secured Data Lake, creating and maintaining an optimal pipeline architecture.
* Examine complex data to optimize the efficiency and quality of the data being collected, resolve data quality problems, and collaborate with database developers to improve systems and database designs
* Hands-on building data applications using AWS Glue, Lake Formation, Athena, AWS Batch, AWS Lambda, Python, Linux shell & Batch scripting.
* Hands on experience with AWS Database services (Redshift, RDS, DynamoDB, Aurora etc.)
* Experience in writing advanced SQL scripts involving self joins, windows function, correlated subqueries, CTE's etc.
* An understanding of data management fundamentals, including concepts such as data dictionaries, data models, validation, and reporting.
Education and Training
* 3-5 years of full-time software engineering experience with at least 2 years in an AWS environment focused on application development.
* Bachelor's degree or foreign equivalent degree in Computer Science, Software Engineering, or relat...
- Rate: Not Specified
- Location: Jersey City, US-NJ
- Type: Permanent
- Industry: Finance
- Recruiter: INSURANCE SERVICES OFFICE INC
- Contact: Not Specified
- Email: to view click here
- Reference: 1187
- Posted: 2025-06-06 08:47:15 -
- View all Jobs from INSURANCE SERVICES OFFICE INC
More Jobs from INSURANCE SERVICES OFFICE INC
- M365 and Digitial Collaboration Manager
- Customer Service - Inside Sales Representative
- Foundry Helper - 2nd Shift (Cudahy, CA)
- F&B Server - Mezzaluna - InterContinental Residence SuitesĀ® Dubai Festival City
- Nurse Practitioner - Per Diem - Evernorth - Washington DC
- Senior Director Consultant Strategy (Hybrid)
- HVAC Technician
- Accountable Care Economics Business Analytics Senior Advisor-Evernorth - Hybrid
- Application Development Senior Advisor- Hybrid
- Him Coder III
- Registered Nurse (RN)
- Clinical Concierge (Medical Assistant)
- Registered Nurse (RN)
- Clinical Concierge (LVN-Cert Medical Assistant)
- Ambulatory Registered Nurse Coordinator
- Registered Nurse (Oncology)
- Substitute Teacher
- Registered Nurse (Oncology)
- Occupational Therapist - PRN
- Physical Therapist - $2,500 Sign on Bonus!*