Databricks Senior Architect

Job Description:

As a Databricks Senior Architect (data engineering, analytics, AI/ML, big data, cloud), you will lead hands-on environment standup and development process.

You will be a key part of the team, acting as a technical advisor, and working with the development team to achieve tangible data-driven outcomes using our Databricks platform, establishing a clear architectural vision and identifying compelling use cases, helping Primoris realize value.

You will grow as a leader in your field, while finding solutions to our biggest challenges in big data, analytics, data engineering and data science problems.

Key Responsibilities:


* Assist in architecting, developing, deploying, or migrating their use cases and workloads into production on Databricks Lakehouse.


* Be the first contact for any technical challenge or questions related to development and production


* Collaborate with the users, technical and support teams, to complete projects on a timely manner


* Implement Databricks Product Innovations, Private Previews and Upgrades if needed


* Provide regular internal and external updates on progress and risks/blockers to your leadership


* Contribute to the development of the team by sharing best practices and assets.


* Operate as an expert solution architect and trusted advisor for significant data analytics architecture, design, development, and adoption of the Databricks Data Intelligence Platform.


* Build Databricks serverless platform that powers the big data, machine learning and Gen AI workloads.

Automatically improves the performance and efficiency of workloads running on the platform.


* Build multi-language (SQL, Python) notebooks with a focus on Data Engineering, Data Science (AI/ML)

Qualifications:


* A minimum of a bachelor’s degree in computer science, Information system, Engineering, Data Science, or equivalent experience through work experience.


* 5+ years of experience where you have been accountable for technical delivery as an Architect within the domain of Data and AI and where you can contribute to the technical debate and design choices with our customers.


* Experience in architecting and implementing Databricks solution using Medallion architecture.


* Hands-on expertise with Databricks implementation on Azure.

Azure security/networking knowledge advantageous.


* Experience designing and developing large-scale distributed systems, and big data technologies such as Apache Spark™, Hadoop or Cassandra.


* Proficient with writing code in Python, and SQL.


* Proficient in designing/implementing Auto Loader, DLT (Delta Live Tables), and Streaming solutions which handle structured, semi structured and unstructured data in Databricks.


* Understanding of how to attribute business value and outcomes to specific project deliverables.


* Experience conducting discovery workshops, creating strategic roadmaps, conducting business analysis, and...