Job Title: Azure Data Engineer
Location: Branchville, NJ, Charlotte, NC and Hartford CT
Years of Experience: 7 10 Years
Job Summary:
We are seeking a highly skilled Data Engineer with a strong background in Azure Databricks to join our dynamic team. The ideal candidate will have 7 10 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and data solutions. This role requires a deep understanding of data architecture, data modeling, and ETL processes, with a specific emphasis on leveraging Azure Databricks for data processing and analytics.
Responsibilities:
Design, develop, and maintain robust data pipelines using Azure Databricks to support data ingestion, transformation, and storage.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions.
Implement best practices for data governance, data quality, and data security within the Azure environment.
Optimize existing data workflows and processes for performance and scalability.
Monitor and troubleshoot data pipeline performance issues, ensuring timely resolution.
Document data engineering processes, architecture, and workflows for knowledge sharing and compliance.
Stay updated with the latest trends and technologies in data engineering and Azure Databricks.
Mandatory Skills:
Strong expertise in Azure Databricks, including experience with Spark, Delta Lake, and data processing frameworks.
Proficient in programming languages such as Python, Scala, or SQL for data manipulation and analysis.
Experience with data modeling, ETL processes, and data warehousing concepts.
Solid understanding of cloud data architecture and services, particularly within the Azure ecosystem.
Familiarity with data visualization tools and techniques.
Preferred Skills:
Experience with Azure Data Factory, Azure Synapse Analytics, and other Azure data services.
Knowledge of machine learning concepts and frameworks.
Experience with CI/CD practices and tools for data engineering.
Familiarity with containerization technologies such as Docker and Kubernetes.
Strong analytical and problem solving skills, with the ability to work independently and in a team environment.
Qualifications:
Bachelor's degree in Computer Science, Information Technology, or a related field.
7 10 years of experience in data engineering or a related field.
Proven experience working with Azure Databricks and related technologies.
Strong communication skills, with the ability to convey complex technical concepts to non technical stakeholders.
If you are a passionate Data Engineer with a strong background in Azure Databricks and are looking for an exciting opportunity to make an impact, we encourage you to apply!
...seeking an enthusiastic and guest-focused Barista to join the Delta Hotels Caf team at... ...Matteson Chicago. Our caf serves Starbucks coffee and specialty beverages, providing hotel... ...Qualifications ~Previous caf, coffee shop, restaurant, hotel, retail, or customer-...
...Job Summary The Inpatient Director of Pharmacy position is responsible for implementing departmental policies relevant to the operation of Inpatient Pharmacy Departments, for assisting in planning and implementing new concepts in drug distribution and control in...
...Paramedic Position Pay Rate: Paramedic: $1150 - $1250 Gross every week Number of Positions: 1 Start Date: ASAP Assignment Length... ...Health insurance Paid sick time Paid time off Travel reimbursement Vision insurance Mobile Timekeeping...
...Earn $25-30+ per hour (hourly and commission) as a Lead Generator with Mountain Home Services!Our Lead Generators work onsite at our partner retail locations (in Logan), greeting and engaging with customers face-to-face while generating interest in scheduling service...
...Environmental Intern TRC is seeking highly motivated and diverse Environmental Interns for our Summer 2027 intern program out of our... ...applications (AutoCad, MathCad, ESRI, HydroCad, WaterCad, ARCView GIS, etc.) is preferred but not required. OSHA 40-hour safety or...