Summary

As a Software Engineer on the Data Solutions team, you’ll be responsible for building and maintaining the backend services that power our cloud and on-premise products. These services are critical for vending data to our customers via API, tracking usage and billing, monitoring our data landscape, generating alerts for our customers, transforming and piping hundreds of terabytes of data, and much more. You’ll help us to raise the bar on code quality, while working closely with our team of software engineers, data engineers, data scientists, and product managers to drive globally impactful results and build trust in our software.The work that you lead and contribute to will provide our customers with the ability to derive powerful and unique insights that drive global investigatory efforts, trans-national threat actor monitoring, national security enhancements, and much more.

In this role, you’ll: 

1. Play a key role in delivering new capabilities to the Data Solutions platform.
2. Bring exciting new ideas and energy to the team, that we will go on to integrate into building the future of Data Solutions.
3. Contribute to improving the scalability and performance of our systems.
4. Solve complex engineering problems with peers and stakeholders across the organization.
5. Build trust in our software, by continuously improving the security and reliability posture of everything we deliver.

We’re looking for candidates who:  

1. Are Python experts
2. Are comfortable building backend ETL pipelines and services in a Cloud environment (AWS, GCP)
3. Have an understanding of how blockchains work, and core tenets of decentralized systems
4. Have experience working with SQL databases
5. Have an expertise in APIs, data streaming systems, and event-driven workflows
6. Have a high degree of ownership and appetite for responsibility
7. Have experience working with distributed systems (microservice architectures, Kubernetes deployments, etc.)
8. Exemplify a high degree of pride in what you create, and own
9. Experience developing systems that scale to support high volumes of traffic (hundreds to thousands of requests per second)

Nice to have experience:

1. Deep blockchain knowledge (writing smart contracts in Solidity, etc.)
2. Experience with PySpark/DLT

Technologies we use: 

1. Python
2. Kubernetes
3. Cloudflare
4. Docker
5. Databricks
6. Terraform
7. GCP & AWS
8. Databricks
9. Kafka
10. Cloud Functions

Skills

• Database Management
• Development
• Python
• Software Engineering
• SQL