Perch is looking for a DevOps Engineer with an interest in scalable, high-throughput, systems to join our DevOps/Sensor Engineering team. We rely on our DevOps team to build and maintain the infrastructure that allows us to ingest 12TB a day and make 275TB of data searchable in real time. We are looking for motivated, self-sufficient problem solvers with a “get stuff done” attitude.
A day in the life
- Write Python and Go to add new features to our on-prem hardware devices running linux (Sensors).
- Assist in monitoring, maintaining, and upgrading out data pipeline infrastructure. (Kafka, Logstash, and Elasticsearch clusters)
- Set up new nodes and add them to the cluster.
- Run queries to check or update cluster configuration and settings.
- Research upcoming versions, performance strategies, and different storage architectures.
- Migrate applications and services to a kubernetes platform.
- Participate in incident response and resolution. Help us fight fires.
A perfect match
- Experience building highly-reliable, scalable, high-throughput systems in Python or Golang.
- We love hearing about your experiences, or even better seeing some of your work.
- Experience maintaining those highly-reliable, scalable, high-throughput systems ;)
- Experience with container-orchestration a plus: ECS, Kubernetes, Beanstalk, etc.
- Alternatively, experience building and maintaining sensor-based systems that source data to a pipeline.
- Knowledge of message queueing or streaming systems: AMQP, SQS, Kafka, etc.
- Exposure to non-relational (NoSQL) databases: MongoDB, Elasticsearch, etc.
- Experience maintaining large clusters is a major plus.
- Experience maintaining and working with Linux-based systems.
- Previous devops or sysadmin experience desirable but not required.
- Experience with at least one major cloud provider. We use AWS.
- Exposure to automation / config manager frameworks: Salt, Chef/Puppet, Ansible, Terraform, etc.
- Comfortable writing scripts (any language) to automate the little stuff.
Above and beyond
- An interest in cybersecurity is a plus but not required
- You’ve worked on bug bounty programs or occasionally participated in CTF events.
- Familiarity with Intrusion Detection/Protection Systems (IDS/IPS) and/or Endpoint Detection and Response (EDR).