Senior Azure Data Engineer Job at eTeam, Redmond, WA

  • eTeam
  • Redmond, WA

Job Description

Job Title: Senior Azure Data Engineer

Location: Redmond, WA 98052

Work Setup: Hybrid

Duration: 12 Months

Experience: 8-10 Years


Job Description


We are looking for an experienced Senior Azure Data Engineer with 8-10 years of experience in data engineering and strong hands-on expertise in Python, SQL, Apache Spark, PySpark, and Azure Databricks .


The candidate will be responsible for developing and supporting scalable data pipelines, transforming large datasets, and optimizing data processing solutions using Azure cloud technologies.


Must Have Skills

  • Strong experience with Python and SQL
  • Hands-on experience with Apache Spark, PySpark, and Spark SQL
  • Strong experience with Azure Databricks , including:
    • Notebooks
    • Jobs/Workflows
    • Clusters
  • Experience with Azure Synapse
  • Strong knowledge of Delta Lake
  • Experience working with Parquet
  • Hands-on experience with ADLS Gen2
  • Strong understanding of data engineering and ETL/ELT concepts
Nice to Have Skills
  • Experience with Scala
  • ETL/ELT development
  • Experience with MERGE/Upsert operations
  • Knowledge of data partitioning and partition pruning
  • Strong Spark performance tuning experience
  • Experience handling data skew, shuffles, caching, broadcast joins, and partition optimization
  • Experience with Git
  • Experience with Azure DevOps and CI/CD
Key Responsibilities
  • Develop and maintain scalable ETL/ELT data pipelines
  • Extract, transform, clean, and load data from various source systems
  • Build data solutions using Azure Databricks, Spark, Delta Lake, Synapse, and ADLS Gen2
  • Implement MERGE/Upsert logic using Delta Lake
  • Design effective partitioning strategies for large datasets
  • Optimize Spark jobs for performance and cost
  • Manage data skew, shuffles, caching, partitions, and cluster resources
  • Collaborate with development and data teams to deliver reliable data solutions
  • Follow best practices for Git, Azure DevOps, and CI/CD where applicable

Job Tags

Similar Jobs

Systems Planning and Analysis, Inc

Open Source Intelligence Analyst Job at Systems Planning and Analysis, Inc

 ...providing innovative solutions for our Nations most pressing security challenges. We have an upcoming need for an Open Source Intelligence Analyst to provide onsite support out of Quantico, VA and Stafford, VA. Responsibilities The Open Source Intelligence Analyst... 

Gap Inc.

Regional Asset Protection Manager Job at Gap Inc.

 ...Gap Inc. is seeking an Area AP Manager to lead asset protection across multiple stores. You will coach AP Coordinators and Specialists, drive shortage reduction, and partner with store leadership to mitigate risk. Your work protects people, products, and experiences across... 

HouseSitter.com

House Sitter Wanted - Reliable House Sitter Needed In Morrow, Ga Earn $150 Daily For Easy Home Care Duties! Job at HouseSitter.com

Im looking for a reliable house sitter who loves pets! I need someone to take care of my furry friends and keep an eye on my home while I'm away. Please contact me if you're interested (...@gmail.com)Please visit to view full details and to apply. Lots of jobs to choose... 

Michael Baker International

GIS Intern Job at Michael Baker International

 ...Part-Time Summer 2026 Interns Michael Baker International is seeking to hire Part-Time Summer 2026 Interns work in the field in Kansas...  ..., you will get the opportunity to work with a team of seasoned GIS and Project Managers to assist on Indoor Mapping field collection... 

University of Texas at Austin Dell Medical School

Urology - Physician Job at University of Texas at Austin Dell Medical School

 ...About Dell Medical School As part of The University of Texas at Austin, one of the nations leading research universities, the Dell Medical School pursues innovation in the redesign of healthcare delivery, excellence in healthcare research, and programs in interdisciplinary...