Databricks Developer Job at Endurance IT Services, Virginia Beach, VA

eVY2RHJsa2g2cWcxSXA1Sy8vemIzQWV3Tmc9PQ==
  • Endurance IT Services
  • Virginia Beach, VA

Job Description

Databricks Developer - Virginia Beach (Hybrid On/Off Site) 

Key Responsibilities:

 

  • Design, develop, and maintain robust data pipelines using Azure Databricks and Azure Data Factory.
  • Implement and manage Delta Live Tables for real-time data processing and streaming.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Utilize Python for data extraction, transformation, and loading (ETL) processes.
  • Integrate and automate DevOps practices into the data engineering workflow, ensuring smooth CI/CD processes.
  • Monitor and optimize data workflows for performance, reliability, and scalability.
  • Maintain comprehensive documentation of data pipelines, transformations, and workflows.
  • Troubleshoot and resolve issues related to data pipelines and infrastructure.
  • Contribute to the continuous improvement of data engineering practices and processes.
  • Develop and maintain data visualizations and reports using Power BI.
  • Leverage JavaScript experience for any necessary front-end data integration tasks.

 

Qualifications:

 

  • Minimum of 3 years of experience as a Data Engineer or in a similar role.
  • Proficiency in Azure Databricks and Azure Data Factory.
  • Strong programming skills in Python.
  • Experience with Delta Live Tables and real-time data processing.
  • Solid understanding of DevOps practices and tools.
  • Familiarity with version control systems, particularly Git.
  • Experience with CI/CD pipelines and infrastructure as code (IaC).
  • Knowledge of database management systems and data warehousing concepts.
  • Experience with Power BI for data visualization and reporting.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and teamwork abilities.
  • JavaScript experience is a plus.

 

Preferred Skills:

 

  • Experience with additional Azure services such as Azure SQL Database, Azure Synapse Analytics, and Azure Cosmos DB.
  • Knowledge of machine learning frameworks and libraries.
  • Familiarity with big data technologies like Hadoop and Spark.
  • Understanding of RESTful APIs and microservices architecture.

Benefits

Paid Days Off

health

Vision

Dental

401K

Life Insurance

Long/Short Term Disability 

Paid certifications

Job Tags

Full time, Temporary work,

Similar Jobs

LaBonne's Markets

Deli Clerk - Part Time Job at LaBonne's Markets

 ...We are hiring a part-time deli associate at LaBonne's Market! What will you be doing? The role involves assisting customers by slicing cold cuts, packaging deli salads, making the occasional sandwich, and light cleaning. Who will you work with? The deli team is... 

Volvo Cars Walnut Creek

Internet/Retail Sales Rep.- Automotive Sales Person - Volvo Cars Dublin Job at Volvo Cars Walnut Creek

 ...Service: 2 year (Preferred)Full Job DescriptionVolvo Cars Dublin is looking for experienced automotive Internet/Retail...  ...pay Hourly + flat commission + unit bonus. Fastest growing Volvo Dealership in the Bay Area.DUTIES & RESPONSIBILITIES:* Generate... 

U.S. Navy

Active Duty and Reserve Enlisted Navy Intelligence Specialist - Regular Job at U.S. Navy

 ...THIS IS A UNITED STATES NAVY ENLISTED POSITION JOB DESCRIPTION: Intelligence Specialists' work with military information, particularly classified information about enemies or potential enemies, is called intelligence. Intelligence Specialists analyze intelligence... 

Compass Group

Director of Food & Beverage Operations Job at Compass Group

 ...by Forbes, Levys diverse portfolio includes award-winning restaurants; iconic sports and entertainment venues, zoos and cultural...  ..., NBA, NFL, and MLS All-Star Games. Job Summary The Director of Operations is responsible for leading our team at the location ... 

Lakeville Station

Line Cook (Lead) Job at Lakeville Station

 ...in a kitchen OR another fast-paced job environment and a willingness to work . You should also be available to take evening and weekend shifts. Essential Duties and Responsibilities of a Line Cook (WE WILL TRAIN MOTIVATED ENTHUSIASTIC PEOPLE) Helps set up the...