Software Engineer - Data Infrastructure - Kafka
Canonical
About the position
Join a collaborative team focused on automating data platform operations and managing Big Data technologies.
Tech stack
- python
- kafka
- spark
- mysql
- postgresql
- mongodb
Requirements
Required:
- Proven hands-on experience in software development using Python
- Proven hands-on experience in distributed systems, such as Kafka and Spark
- Have a Bachelor’s or equivalent in Computer Science, STEM, or a similar degree
- Willingness to travel up to 4 times a year for internal events
Nice to have:
- Experience operating and managing other data platform technologies, SQL and/or NoSQL, similar to DBA level expertise
- Experience with Linux systems administration, package management, and infrastructure operations
- Experience with the public cloud or a private cloud solution like OpenStack
- Experience with operating Kubernetes clusters and a belief that it can be used for serious persistent data services
Responsibilities
- Collaborate proactively with a distributed team
- Write high-quality, idiomatic Python code to create new features
- Debug issues and interact with upstream communities publicly
- Work with helpful and talented engineers including experts in many fields
Benefits
- Fully remote working environment - we’ve been working remotely since 2004!
- Personal learning and development budget of 2,000USD per annum
- Annual compensation review
- Recognition rewards