Lead Data Engineer (US)
Dallas, TX
Contracted
Experienced
Project Overview
This project is a high-impact business process engine designed to optimize customer pharmacy procurement. The system analyzes the purchase ratio between preferred and non preferred suppliers We need a Senior Solution Architect who can command a high-pressure environment, architect a robust technical roadmap, and provide immediate direction to a team of developers.
Core Responsibilities
This project is a high-impact business process engine designed to optimize customer pharmacy procurement. The system analyzes the purchase ratio between preferred and non preferred suppliers We need a Senior Solution Architect who can command a high-pressure environment, architect a robust technical roadmap, and provide immediate direction to a team of developers.
Core Responsibilities
- Design and guide the implementation of new features.
- Be hands on with development, using the required technical skills listed above.
- Give clear coding guidance to offshore team, review code, and help unblock technical issues for the team.
- Choose the smart and quick path over over-engineering, balancing immediate business needs with long-term platform stability.
- 7+ years of software development experience with **3+ years** in a lead/senior role
- Expert-level proficiency in Python and PySpark for big data processing
- Strong experience with Azure Databricks and Azure cloud ecosystem (ADF, ADLS Gen2, Key Vault)
- Deep understanding of distributed computing concepts and Spark optimization technique.
- Hands-on experience** with MongoDB and SQL databases.
- Proficiency in Git, CI/CD pipelines, and DevOps practices
- Experience with data modeling, ETL design patterns, and data warehousing concepts
All our positions are Remote and are available as Full Time Employment or B2B Contracts
Apply for this position
Required*