Job Description

Summary

We are seeking a highly skilled Backend Engineer with experience in ETL processes, data pipelines, and a range of data technologies. The ideal candidate be proficient in designing, developing, and maintaining ETL processes and data pipelines, as well as working with OLAP databases. Experience with Apache Pinot, Airbyte, and Airflow is essential. Additionally, the candidate should have experience with both RESTful and GraphQL APIs and be familiar with deploying applications on Hausra Cloud.

Key Responsibilities:

  1. Design, develop, and maintain ETL processes and data pipelines.
  2. Work with OLAP databases and ensure efficient data storage and retrieval.
  3. Utilize Apache Pinot for real-time data analytics.
  4. Implement and manage data integration using Airbyte.
  5. Orchestrate data workflows with Apache Airflow.
  6. Develop and maintain RESTful and GraphQL APIs for data services.
  7. Deploy and manage applications on Hausra Cloud.
  8. Collaborate with cross-functional teams to understand data requirements and provide scalable solutions.
  9. Ensure data quality, integrity, and security across all pipelines.

Required Skills and Experience:

  1. Proven experience in ETL development and data pipeline management.
  2. Strong understanding of OLAP systems.
  3. Hands-on experience with Apache Pinot.
  4. Proficiency in using Airbyte for data integration.
  5. Expertise in Apache Airflow for workflow orchestration.
  6. Experience in developing RESTful and GraphQL APIs.
  7. Familiarity with Hausra Cloud or similar cloud platforms.
  8. Excellent problem-solving skills and attention to detail.
  9. Strong communication skills and ability to work in a collaborative team environment.

Qualifications:

  1. Bachelor's degree in Computer Science, Information Technology, or a related field.
  2. 3+ years of experience in backend engineering with a focus on data pipelines and ETL processes.
  3. Demonstrated ability to work in a fast-paced, dynamic environment.

Skills
  • Attention to Detail
  • Communications Skills
  • Development
  • Problem Solving
  • Team Collaboration
© 2024 cryptojobs.com. All right reserved.