Databricks Developer Job at Endurance IT Services, Virginia Beach, VA

eVY2RHJsa2g2cWcxSXA1Sy8vemIzQWV3Tmc9PQ==
  • Endurance IT Services
  • Virginia Beach, VA

Job Description

Databricks Developer - Virginia Beach (Hybrid On/Off Site) 

Key Responsibilities:

 

  • Design, develop, and maintain robust data pipelines using Azure Databricks and Azure Data Factory.
  • Implement and manage Delta Live Tables for real-time data processing and streaming.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Utilize Python for data extraction, transformation, and loading (ETL) processes.
  • Integrate and automate DevOps practices into the data engineering workflow, ensuring smooth CI/CD processes.
  • Monitor and optimize data workflows for performance, reliability, and scalability.
  • Maintain comprehensive documentation of data pipelines, transformations, and workflows.
  • Troubleshoot and resolve issues related to data pipelines and infrastructure.
  • Contribute to the continuous improvement of data engineering practices and processes.
  • Develop and maintain data visualizations and reports using Power BI.
  • Leverage JavaScript experience for any necessary front-end data integration tasks.

 

Qualifications:

 

  • Minimum of 3 years of experience as a Data Engineer or in a similar role.
  • Proficiency in Azure Databricks and Azure Data Factory.
  • Strong programming skills in Python.
  • Experience with Delta Live Tables and real-time data processing.
  • Solid understanding of DevOps practices and tools.
  • Familiarity with version control systems, particularly Git.
  • Experience with CI/CD pipelines and infrastructure as code (IaC).
  • Knowledge of database management systems and data warehousing concepts.
  • Experience with Power BI for data visualization and reporting.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and teamwork abilities.
  • JavaScript experience is a plus.

 

Preferred Skills:

 

  • Experience with additional Azure services such as Azure SQL Database, Azure Synapse Analytics, and Azure Cosmos DB.
  • Knowledge of machine learning frameworks and libraries.
  • Familiarity with big data technologies like Hadoop and Spark.
  • Understanding of RESTful APIs and microservices architecture.

Benefits

Paid Days Off

health

Vision

Dental

401K

Life Insurance

Long/Short Term Disability 

Paid certifications

Job Tags

Full time, Temporary work,

Similar Jobs

Amazing Athletes

Kids Sports Coach Job at Amazing Athletes

 ...Amazing Athletes is seeking a Sports Coach to join their team. As the largest multi-sport enrichment program in the country, Amazing Athletes focuses on providing children ages 1-6 with positive movement experiences to help them meet their motor-development milestones... 

Focused HR Solutions

8/11 Cobol Developer 85 Job at Focused HR Solutions

 ...This job is remote. You may be required to come on-site for meetings in Clemson, SC Our direct client has an opening for a Cobol developer 11315-1. This position is up to 12 months with the option of extension and is located in Clemson, sc. W2 only no 1099s or subcontracting... 

Great Lakes Coca-Cola

Sales Internship (Foodservice & On Premise, Madison/Wisconsin Dells) Job at Great Lakes Coca-Cola

 ...related programs. The Madison, WI based internship will support our Foodservice & On Premise team focusing primarily on the Wisconsin Dells area, and will last approximately 12 weeks during Summer 2025. Interns will work collaboratively with our sales professionals out in... 

AdeIphi MedicaI Staffing

Orthopedic Surgeon #71153 Job at AdeIphi MedicaI Staffing

 ...Job Quick Facts: Specialty: Orthopedic Surgery Job Type: Locum Tenens Facility Location: Las Cruces, NM Service Setting: Inpatient Reason For Coverage: Supplemental Coverage Period: Dec 23, 2024 - Ongoing Coverage Type: Call Only Shifts needed... 

GolfJobs

Golf Course Superintendent Job at GolfJobs

Share this job:Golf CourseSuperintendent 1 October 2024Category: Golf Course Superintendent JobsCountry: USAState: ArizonaApply for this job.Click the button below to apply for this job.Apply NowAlready have an account? Log in firstGolf Course Superintendent...