Job Description

Job Title: Lead Data Engineer

Location: Washington,Dc

Department:  Congressional Budget Office (CBO)

Job Summary:

The Lead Data Engineer will play a crucial role in designing, building, and maintaining the data infrastructure of our organization. This position is responsible for overseeing the architecture and development of data pipelines that handle the collection, transformation, and storage of data within cloud environments. The Lead Data Engineer ensures that the data infrastructure meets the organization's requirements for performance, scalability, and accessibility.

Key Responsibilities:

Architecture Design:

• Design and implement scalable data architectures to meet the organization's data needs.
  
• Develop strategies for data ingestion, transformation, storage, and retrieval in cloud environments.
  
• Ensure data architectures are aligned with organizational goals and industry best practices.
  

Data Pipeline Development:

• Lead the development and optimization of data pipelines for efficient data collection, transformation, and loading.
  
• Implement ETL (Extract, Transform, Load) processes to support various analytical and operational needs.
  
• Utilize cloud-based technologies such as AWS, Azure, or Google Cloud Platform for data processing and storage.
  
• Performance and Scalability:
  
• Monitor and optimize data pipeline performance to ensure high availability and reliability.
  
• Develop solutions that scale with increasing data volume and complexity.
  
• Implement best practices for data partitioning, indexing, and caching.

Data Integration:

• Integrate data from diverse sources, including databases, APIs, and third-party services.
  
• Ensure data quality and consistency across integrated systems.
  
• Team Leadership:
  
• Lead and mentor a team of data engineers, providing guidance on technical challenges and career development.
  
• Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to support data-driven initiatives.
  

Compliance and Security:

• Implement data security and privacy measures to protect sensitive information.
  
• Ensure compliance with relevant data governance and regulatory requirements.
  
• Documentation and Reporting:
  
• Document data architecture, pipelines, and processes.
  
• Provide regular reports on data infrastructure performance and issues.
  

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field. Master’s degree preferred.
  

Experience:

• 7+ years of experience in data engineering, with a focus on designing and implementing data pipelines in cloud environments.
  
• Proven experience with cloud platforms (AWS, Azure, Google Cloud Platform) and associated data services.
  
• Strong background in ETL processes, data warehousing, and big data technologies (e.g., Hadoop, Spark).
  

Skills:

• Proficiency in programming languages such as Python, Java, or Scala.
  
• Experience with SQL and NoSQL databases.
  
• Familiarity with data modeling, data warehousing, and data lake concepts.
  
• Excellent problem-solving skills and the ability to work with large datasets.
  

Soft Skills

• Strong leadership and team management abilities.
  
• Effective communication skills, with the capability to explain complex technical concepts to non-technical stakeholders.
  
• Demonstrated ability to work in a fast-paced, collaborative environment.
  

"If you are: bright, motivated, skilled, a difference-maker, able to get things done, work with minimum direction, enthusiastic, a thinker, able to juggle and multi-task, communicate effectively, and lead, then we would like to hear from you. We need exceptionally capable people for this role for our client, so get back to us and tell us why you think you are a fit."

About Us:

Tri-Force is one of the fastest growing companies in Philadelphia region by receiving the award 5 times and 3 times(Ranked #931 2021) on Inc. 5000 fastest growing companies in the USA. Tri-Force Consulting Services, Inc. is an established consulting services firm offering innovative solutions to Government and Commercial sectors. We specialize in building customized software applications solutions such as knowledge management systems, business intelligence, data analysis, database support and maintenance, data warehouse implementation and support, systems architecture and systems integration for our clients. Our technical competencies are in Java,.NET, SharePoint, PHP, Business Intelligence (Cog nos, Data Warehouse), mobile applications platforms (iPhone, iPad, Android, Blackberry), and various other technologies. We also specialize in providing resources to manage infrastructure projects. Tri-Force is one of the fastest growing companies in the Philadelphia region by receiving the award 5 times and 2 times on Inc. 5000 fastest growing companies in the USA.

Job Tags

Similar Jobs