Senior Software Engineer - Data & BI

ROLE SUMMARY

The Sr.

Software Engineer - Data & BI is responsible for designing, developing, and optimizing scalable cloud based data pipelines and analytics solutions using Azure Data Factory, Databricks, and Lakehouse architecture.

This role works extensively with business partners across Subaru of America to understand their business processes, data needs, and operational challenges, and to translate those into high quality, secure, and scalable data solutions.

Although this position is primarily focused on data engineering, it also supports business intelligence initiatives by assisting in building basic Power BI dashboards, supporting said dashboards and ensuring data is structured and ready for reporting and decision making.

CORE RESPONSIBILITIES

Data Ingestion & Storage (ADF, Databricks)


* Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory and Databricks.


* Develop complex transformations and large‑scale processing using PySpark.


* Integrate data from on‑prem Oracle systems, Dynamics CRM, connected vehicle telematics, APIs, and other sources.


* Manage data layers within Azure Data Lake and Lakehouse structures.

Data Engineering & Modeling


* Develop robust data models, schemas, and curated datasets optimized for analytics and BI.


* Use Unity Catalog to maintain governance, security, and lineage.


* Optimize data storage, query patterns, transformation logic, and pipeline reliability.


* Collaborate with EDW and Data Science teams to ensure data readiness.

Business Collaboration & Requirements Gathering


* Work closely and proactively with business partners to understand their processes, data challenges, and reporting requirements.


* Translate business needs into technical data specifications and scalable engineering solutions.


* Communicate technical concepts clearly to non‑technical stakeholders and provide recommendations based on best practices.


* Participate in cross‑functional workshops, requirement sessions, and design discussions.

Data Integration & Governance


* Harmonize data from disparate systems into unified, trusted datasets.


* Ensure data quality, consistency, and reliability.


* Contribute to enterprise data governance policies, processes, and frameworks.

Version Control & DevOps


* Use GitHub for version control, code reviews, CI/CD pipelines, and release automation.


* Adhere to established coding standards, branching strategies, and deployment best practices.

Business Intelligence Support


* Build and maintain simple‑to‑intermediate Power BI dashboards and datasets.


* Assist BI developers with data model optimization and dataset certification.


* Partner with business teams to verify that data supports accurate reporting and KPIs.


* Contribute to Power BI governance (naming conventions, refresh cycles, usage optimization).

ADDITIONAL RESPONSIBILITIES


* Collaborate with c...