Pipeline Engineer (Intermediate)

Description & Requirements

We are seeking an Intermediate Data Pipeline Engineer to join our team supporting an Internal Revenue Service (IRS) client.

The Data Pipeline Engineer will work with a team of Data engineers and ETL specialists and conduct hands-on development as a member of an integrated agile project team.

Position is remote within US.

Ideal candidates will be in Lanham MD or Farmers Branch or Austin TX areas.

Local candidates may attend meetings occasionally at the IRS facility.

Essential Duties and Responsibilities:
- Determine operational feasibility by evaluating analysis, problem definition, requirements, solution development, and proposed solutions.
- Document and demonstrate solutions by developing documentation, flowcharts, layouts, diagrams, charts, code comments, and clear code.
- Prepare and install solutions by determining and designing system specifications, standards, and programming.
- Improve operations by conducting systems analysis and recommending changes in policies and procedures.
- Provide information by collecting, analyzing, and summarizing development and service issues.

Job-Specific Essential Duties and Responsibilities:

- Develop, deploy and maintain components of the Data pipeline using tools such as Databricks, Informatica, SQL and other tools.

- Participate in high level design and solutioning sessions to build high performance

data pipelines.

- Provide support for initial tool analysis and/or implement proof of concept implementations.

- Support ETL and BI functionalities of the application

- Provide support to technical team, writing the necessary required documentation as per the IRS development methodology for ETL integration.

- Coordinate, plan, communicate, develop and review client presentations and documentation required under the IRS Enterprise Lifecycle

- Implementation knowledge of Python

- Experience with performance optimization of Data pipelines

- Good problem-solving skills with architectural, design and hands on development experience

- Experience working in and a general understanding of Red Hat Linux OS, or other Unix-like OS

- Experience with Shell scripting

Job-Specific Minimum Requirements:

- Bachelor's Degree from an accredited college or university required; an additional four (4) years of related work experience can substitute for a degree

- At least three (3) years of relevant experience required

- Minimum of two (2) years' Experience working with IRS data such as IRTF, IRMF, CADE2, IMF, BMF, BRTF and others.

- Possess an active IRS MBI

- Experience working with IRS data in both legacy and modernized formats.

- Experience integrating a range of technologies in a large federal IT environment such as the IRS.

Preferred Skills and Qualifications:

- Experience building AI pipelines, knowledge of AWS AI tools such as Bedrock.

- Knowledge of Large Language Models (LLM) and how to apply them to solve data pipeline/data quality issues.

- Experience designing...