Data Engineer
Horizontal Talent

Job Description:
As a Data Engineer I, you will play a crucial role in designing, developing, and maintaining our data pipelines. You will work closely with product managers to understand requirements, collaborate with Principal Architects and the Data Platform team to ensure best practices, and implement robust data models. Your work will involve integrating data from various core systems, including banking, Salesforce CRM, and mortgage platforms.

Key Responsibilities:

• Design, develop, and maintain data pipelines to support enterprise data products.
• Collaborate with product managers to gather and understand requirements.
• Work with cross-functional teams, including Principal Architects and the Data Platform team, to review designs and ensure best practices.
• Apply strong data modeling practices for raw, canonical, and semantic data zones.
• Communicate the story of ingested data effectively.
• Integrate data from core banking systems, Salesforce CRM, and mortgage origination and servicing platforms.
• Utilize a mix of legacy and modern platforms, including MS-SQL, Snowflake, and Azure SQL DB.
• Leverage ETL tools like SSIS, ADF, and DBT for data transformation.
• Follow CI/CD practices using Azure DevOps and ADO.
• Use container tools such as AKS to manage the data lifecycle.

Qualifications:

• 5+ years of experience in data engineering or a related role.
• 3+ years of experience in SQL Programming Knowledge
• 3+ years of experience in programming language Python or Java or, C#
• 2+ years of experience using Git.
• Proficiency in MS-SQL, Snowflake, and Azure SQL DB.
• Hands-on experience with ETL tools such as SSIS, ADF, and DBT.
• Familiarity with CI/CD tools like Azure DevOps and ADO.
• Experience with container tools, specifically AKS.
• Experience with streaming processing technologies - Kafka, Spark Streaming, Azure Service Bus
• Strong understanding of data warehousing, data modeling, and data architecture principles.
• Excellent communication skills, with the ability to tell the story of data clearly and effectively.

Preferred Skills:

• Experience in the banking, mortgage, treasury, wealth management, or insurance industries.
• Familiarity with both legacy and modern data platforms.
• Strong problem-solving skills and attention to detail.

---