Senior Data Engineer
This role will contribute to the design, development, optimization, and maintenance of enterprise-grade data pipelines and supporting infrastructure. They will optimize data flows and data models to ensure comprehensive integration, scalability, and interoperability between data warehousing solutions and connected environments. This will support and enhance data governance framework, driving quality, transparency, accessibility, and compliance throughout Enterprise data landscape.
Responsibilities
Design, develop, maintain, and optimize efficient ETL/ELT solutions to ingest, transform, and integrate data from across enterprise application landscape within Snowflake and other cloud data platforms.
Monitor, troubleshoot, and improve pipeline transparency, performance, scalability, and reliability, using Snowflake OpenFlow and related ELT/ETL tools
Build and scale technology solutions in support of data governance initiatives, including lineage transparency, data quality metrics, security, accessibility, and incident response planning, heavily leveraging Snowflake-native governance features
Produce and maintain documentation detailing data pipelines, data models, and supporting architecture.
Ensure AI/ML readiness of data by preparing and maintaining semantic models, ensuring robust data quality, and establishing and enforcing data access policies
Support AI/ML solutions that improve organizational effectiveness in analytics, decision making, and workflow optimization
Collaborate with cross functional stakeholders (both business and application development teams) to ensure that product & feature launches are quickly integrated with existing data solutions
Keep abreast of industry standards and emerging technologies in data science and data engineering, sustainability, and the built environment
Qualifications
4+ years’ experience in data warehouse or application database development, analytics, business intelligence, or related field.
3+ years of active and frequent coding experience in SQL required. Must have experience developing and optimizing stored procedures for enterprise level solutions.
2+ years hands on experience with enterprise level cloud data warehousing/ETL/ELT solutions, including requirements drafting, data modeling, solution development, deployment, and maintenance. Snowflake experience highly desired.
1+ years experience developing ELT/ETL & orchestration solutions in a structured ELT/ETL environment such as Talend, Fivetran, Matillion, Airbyte, Airflow, etc. is required.
1+ years of active and frequent coding experience in Python required. Must have experience working with APIs via SOAP/REST. Hands on experience with the Pandas library is highly desired.
Foundational understanding of relational and dimensional modeling techniques is required. Expertise in dimensional modeling best practices is highly desired.
Experience with git preferred.
Experience with ERP solutions such as SAP and CRM solutions such as Salesforce preferred
Excellent written & verbal communication skills
All our positions are Remote and are available as Full Time Employment or B2B Contracts