Lead Data Engineer (US)

Dallas, TX
Contracted
Experienced
Project Overview
This project is a high-impact business process engine designed to optimize customer pharmacy procurement. The system analyzes the purchase ratio between preferred and non preferred suppliers  We need a Senior Solution Architect who can command a high-pressure environment, architect a robust technical roadmap, and provide immediate direction to a team of developers.

Core Responsibilities
  • Design and guide the implementation of new features.
  • Be hands on with development, using the required technical skills listed above.
  • Give clear coding guidance to offshore team, review code, and help unblock technical issues for the team.
  • Choose the smart and quick path over over-engineering, balancing immediate business needs with long-term platform stability.
Required Technical Stack
  • 7+ years of software development experience with **3+ years** in a lead/senior role
  • Expert-level proficiency in Python and PySpark for big data processing
  • Strong experience with Azure Databricks and Azure cloud ecosystem (ADF, ADLS Gen2, Key Vault)
  • Deep understanding of distributed computing concepts and Spark optimization technique.
  • Hands-on experience** with MongoDB and SQL databases.
  • Proficiency in Git, CI/CD pipelines, and DevOps practices
  • Experience with data modeling, ETL design patterns, and data warehousing concepts

All our positions are Remote and are available as Full Time Employment or B2B Contracts

Share

Apply for this position

Required*
We've received your resume. Click here to update it.
Attach resume as .pdf, .doc, .docx, .odt, .txt, or .rtf (limit 5MB) or Paste resume

Paste your resume here or Attach resume file

Human Check*