Job Description

Databricks Developer - Virginia Beach (Hybrid On/Off Site) 

Key Responsibilities:

• Design, develop, and maintain robust data pipelines using Azure Databricks and Azure Data Factory.
  
• Implement and manage Delta Live Tables for real-time data processing and streaming.
  
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  
• Utilize Python for data extraction, transformation, and loading (ETL) processes.
  
• Integrate and automate DevOps practices into the data engineering workflow, ensuring smooth CI/CD processes.
  
• Monitor and optimize data workflows for performance, reliability, and scalability.
  
• Maintain comprehensive documentation of data pipelines, transformations, and workflows.
  
• Troubleshoot and resolve issues related to data pipelines and infrastructure.
  
• Contribute to the continuous improvement of data engineering practices and processes.
  
• Develop and maintain data visualizations and reports using Power BI.
  
• Leverage JavaScript experience for any necessary front-end data integration tasks.
  

Qualifications:

• Minimum of 3 years of experience as a Data Engineer or in a similar role.
  
• Proficiency in Azure Databricks and Azure Data Factory.
  
• Strong programming skills in Python.
  
• Experience with Delta Live Tables and real-time data processing.
  
• Solid understanding of DevOps practices and tools.
  
• Familiarity with version control systems, particularly Git.
  
• Experience with CI/CD pipelines and infrastructure as code (IaC).
  
• Knowledge of database management systems and data warehousing concepts.
  
• Experience with Power BI for data visualization and reporting.
  
• Strong problem-solving skills and attention to detail.
  
• Excellent communication and teamwork abilities.
  
• JavaScript experience is a plus.
  

Preferred Skills:

• Experience with additional Azure services such as Azure SQL Database, Azure Synapse Analytics, and Azure Cosmos DB.
  
• Knowledge of machine learning frameworks and libraries.
  
• Familiarity with big data technologies like Hadoop and Spark.
  
• Understanding of RESTful APIs and microservices architecture.
  

Benefits

Paid Days Off

health

Vision

Dental

401K

Life Insurance

Long/Short Term Disability 

Paid certifications

Job Tags

Similar Jobs