Data Engineer

Key Responsibilities:


* Technical Expertise: Provide technical expertise in all capabilities of dbt.


* Development: Design, build, and manage data transformation in dbt.

Create reusable components and templates and proof-of-concept solutions.

Develop and manage data pipelines as needed.

Implement functionality in Snowflake.


* Source to Target Mappings: Work with data team members to analyze source data and identify transformation requirements to move data to our data warehouse and data marts.


* Data Integration: Design robust, reliable, scalable, and performant systems for large volume data processing.

Help drive decisions on data architecture and engineering best practices.


* Data Observability: Develop and enhance monitoring of workflows and processes.


* Solution Design: Collaborate with technical teams to design and implement solutions that meet business requirements and align with best practices.


* Security: Design security standards and ensure proper implementation of security.


* Performance: Ensure our data warehouse processing is optimized for performance.

Collaborate with team members to ensure data loads and transformations flow through the system to deliver data according to requirements.


* Support: Provide comprehensive technical support data warehouse processing.


* Testing and Validation: Develop testing frameworks for solutions to ensure that solutions meet requirements and perform as expected.


* Metadata: Work with business users, technical teams, and data stewards to create documentation and metadata to support understanding of technical data warehouse infrastructure.


* Continuous Improvement: Identify opportunities for process improvements and system enhancements to increase efficiency and effectiveness.

Qualifications:


* Experience:



* Minimum 2+ years of experience developing and scaling dbt projects.


* Minimum 3-5 years of experience as a data engineer with tools like SSIS, Informatica, or Talend.


* Minimum 2+ years of experience with Snowflake.


* Proven experience designing and implementing dbt transformations in large scale enterprise analytics environments.


* Experience working with data pipeline tools like Fivetran or CData.


* Proven experience designing and managing security requirements.


* Experience in supporting data applications.


* Minimum of 5 years working with cross-functional teams and managing multiple projects and priorities.

Additional Technical Skills:


* Expert in SQL and data analysis.


* Strong understanding of data integrations, data warehousing, data modeling, and data engineering.


* Familiarity with Azure and cloud architectures.


* Experience with Python and AI preferred.


* Expert creating architecture diagrams and documenting requirements and design details.

Required Analytical Skills:


* Excellent problem-solving skills and attention to detail.


* Ability to a...