Position: Kafka Developer/Administrator
Location: Mississauga, ON (Onsite)
Employment Type: Full Time
Experience Required: 7 + Years
Role Summary:
We are seeking an experienced Kafka Developer/Administrator to design, implement, manage, and optimize enterprise-scale Apache Kafka platforms across Development, UAT, Testing, and Production environments. The ideal candidate will have strong expertise in Kafka administration, performance tuning, security, automation, troubleshooting, and supporting highly available, mission-critical messaging systems.
Required Skills:
- Strong hands-on experience with Apache Kafka Administration and Support.
- Expertise in Kafka architecture, brokers, topics, partitions, replication, and consumer groups.
- Experience with Kafka Connect, Schema Registry, and distributed messaging systems.
- Knowledge of Kafka security (SSL/TLS, SASL, ACLs).
- Proficiency in Linux/Unix environments and scripting using Shell or Python.
- Experience with monitoring and observability tools such as Prometheus, Grafana, Splunk, or similar.
- Strong troubleshooting, performance tuning, and capacity planning skills.
- Familiarity with cloud platforms, DevOps practices, and CI/CD pipelines is preferred.
Key Responsibilities:
- Install, configure, administer, and maintain Apache Kafka clusters across multiple environments.
- Manage Kafka brokers, topics, partitions, replication, and consumer groups to ensure platform reliability and performance.
- Monitor cluster health, capacity, availability, and resource utilization.
- Perform performance tuning, capacity planning, scaling, upgrades, patching, and migrations.
- Troubleshoot and resolve Kafka infrastructure, connectivity, messaging, and performance issues.
- Implement and manage Kafka security including SSL/TLS, SASL, ACLs, and encryption standards.
- Support Kafka ecosystem components such as Kafka Connect, Schema Registry, and related integrations.
- Design and maintain High Availability (HA) and Disaster Recovery (DR) solutions.
- Collaborate with application, infrastructure, DevOps, and data engineering teams for application onboarding and support.
- Develop automation using Shell Scripting and Python to streamline operational activities.
- Maintain monitoring, logging, alerting, incident management processes, and operational documentation.
- Perform root cause analysis for production incidents and drive continuous platform improvements.
- Participate in on-call support and ensure timely resolution of critical production issues.
Preferred Background:
- Bachelor's degree in Computer Science, Engineering, or related field.
- Experience supporting large-scale, highly available Kafka environments.
- Kafka-related certifications are a plus.
