Azure Data Engineer Job at Omni Inclusive, Pleasanton, CA

  • Omni Inclusive
  • Pleasanton, CA

Job Description

Mandatory Skills: Azure Databricks (ADB), Azure Data Factory (ADF), Azure Analysis Service (AAS), SQL



Job Summary
We are seeking a skilled Azure Data Engineer with strong hands-on expertise in Azure Databricks (ADB), Azure Data Factory (ADF), and SQL. The ideal candidate will design and build scalable data pipelines and transformations on the Azure platform, with solid experience in Spark (PySpark), the Databricks Lakehouse, and ETL/ELT orchestration. Exposure to Delta Lake, data modeling, and CI/CD for data workloads is a plus.



Key Responsibilities
• Design, develop, and maintain data pipelines using Azure Databricks (PySpark/Spark SQL) and Delta Lake.
• Build and orchestrate ETL/ELT workflows in Azure Data Factory, including linked services, datasets, and triggers.
• Write and optimize complex SQL for data transformation, aggregation, and performance tuning.
• Collaborate with cross-functional teams to deliver reliable, high-quality data solutions.
• Implement data quality checks, monitoring, and follow engineering best practices.
• Work in an Agile environment and contribute to sprint planning and retrospectives.



Skill Requirements
• Databricks: Strong proficiency in Azure Databricks, PySpark, Spark SQL, and notebook development.
• Data Integration: Hands-on experience with Azure Data Factory (pipelines, mapping data flows, triggers).
• Database: Expert-level SQL (mandatory) with T-SQL/Spark SQL; query optimization and stored procedures.
• Storage & Format: Experience with Delta Lake, Parquet, and Azure Data Lake Storage (ADLS Gen2).
• Data Modeling: Understanding of dimensional modeling and data warehousing concepts.
• Version Control: Git/Azure Repos or similar tools.
• CI/CD: Familiarity with Azure DevOps pipelines for data deployments.
• Cloud: Working knowledge of the broader Azure ecosystem (Key Vault, Synapse is a plus).

Job Tags

Similar Jobs

Carle Health

RN- Surgical T7 Job at Carle Health

 ...southeastern Illinois. Weve grown to include eight, award-winning hospitals and a multispecialty provider group with more than 1,500...  ...origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local... 

Cornerstone Capital

Bank Teller I Job at Cornerstone Capital

 ...communities thrive. Through its primary subsidiary, Cornerstone Capital Bank, the organization operates a community and business banking...  ...new bank in Texas history.We are seeking a fulltime Teller to join our team! Youll be on the front end of working for an innovative... 

Asbury Automotive Group

New Car Sales Manager Job at Asbury Automotive Group

 ...is currently looking for high Exceptional Sales Professionals! Job Description...  ...Benefits Medical, Dental and Vision Insurance Available 401K Retirement Flexible...  ...Medical Spending Accounts Supplemental Life Insurance Short Term and Long Term... 

NOW Courier

Cargo/Sprinter Van Delivery Driver Job at NOW Courier

 ...for enthusiastic and professional Contract Delivery Drivers to join our successful fleet....  ...Clockwork Precision: Pick up and deliver cargo to our valued customers on time, every time...  ...travel. Preferred Vehicle: Cargo Van or Sprinter are preferred. Requirements... 

Carl Black Automotive Group

TECHNICIAN Job at Carl Black Automotive Group

 ...BASED ON EXPERIENCE $$$ LAPTOP AND MDI PROVIDED TOOLBOX RELOCATION AVALIBLE We provide 100% Match to GM Technician Recognition...  ...time guides, and/or menu pricing. ~ Flexible Schedule ~ Paid training ~ Paid vacation ~ Medical and Dental insurance available...