Job Description
Summary
Join our dynamic team at Keyrock, a leader in the digital asset market making space. We are committed to leveraging cutting-edge technology to provide liquidity and efficient trading solutions in the digital asset ecosystem. We are looking for a skilled Data Engineer to design, build, and maintain robust data pipelines that support our trading and analytics platforms.
Job description
- Design, implement, and maintain scalable and efficient ETL pipelines using Python and SQL to process and store large volumes of financial data.
- Develop and optimize data models and schemas in PostgreSQL and Clickhouse to support complex queries and analytics.
- Build and maintain real-time data streaming and processing systems using AWS Kinesis and Lambda.
- Automate infrastructure management using Terraform for deploying and managing AWS resources, ensuring a secure and scalable environment.
- Collaborate with trading and analytics teams to understand data requirements and ensure the availability and quality of data for decision-making.
- Implement data monitoring and alerting mechanisms to proactively identify and resolve issues in data pipelines.
- Write shell scripts to automate routine data processing tasks and system maintenance.
- Ensure compliance with data governance and security best practices, especially around handling sensitive financial data.
Background and experience
- 3+ years of experience as a Data Engineer or in a similar role within financial services, ideally with exposure to digital assets or cryptocurrency markets.
- Proficiency in Python for data engineering tasks and automation.
- Strong SQL skills for complex query design, optimization, and data modeling.
- Experience with AWS services, specifically Lambda, Kinesis, RDS, S3, and IAM.
- Hands-on experience with Terraform for infrastructure as code and managing AWS environments.
- Familiarity with Clickhouse for handling large datasets and real-time analytics is highly desirable.
- Experience with PostgreSQL for data warehousing and analytics.
- Proficiency in shell scripting for automation and system operations.
- Knowledge of best practices in data architecture, data security, and data governance.
- Strong problem-solving skills and ability to work in a fast-paced, dynamic environment.
- Excellent communication skills and ability to work collaboratively with cross-functional teams.
Competences and personality
- Experience in the digital asset or cryptocurrency trading industry.
- Familiarity with financial market data, trading systems, and algorithms.
- Experience with other data processing and visualization tools like Apache Kafka, Spark, and Sisense.
Skills
- AWS
- Communications Skills
- Cryptocurrency
- Database Management
- Problem Solving
- Python
- SQL
- Team Collaboration