Data/Information Architect

Job Description

Job Description

We’re seeking a highly skilled Senior Confluent Kafka Architect to join our Data Management team. In this pivotal role, you’ll be responsible for architecting, implementing, and maintaining advanced data streaming solutions using Apache Kafka and Confluent technologies.

Key Responsibilities

• Lead the design and deployment of scalable, secure, and high-performance data integration solutions using Confluent Kafka, NoSQL databases, and SQL Server Data Warehouse.
• Build and manage real-time data streaming pipelines leveraging Kafka and its ecosystem.
• Architect a new enterprise-grade Confluent Kafka platform from the ground up.
• Troubleshoot and resolve complex Kafka-related issues, and contribute to project scoping and estimation.
• Ensure data integrity and consistency across streaming pipelines.
• Apply security best practices for Kafka, including encryption, authentication, and access control.
• Provide leadership and guidance to both onshore and offshore technical teams.

• Bachelor’s degree with 7+ years of experience, or Master’s degree with 5+ years in Computer Science, Engineering, Mathematics, or a related field.
• Minimum 5 years of experience in data engineering with a strong focus on Kafka and streaming technologies.
• At least 2 years of hands-on experience with the Confluent Kafka platform.
• 3+ years of experience in Kafka architecture, including leadership on enterprise streaming initiatives (e.g., offset management, partitioning strategies, disaster recovery).
• Proficiency in developing real-time stream processing applications using Kafka Streams and kSQL.
• Strong expertise in configuring Kafka clients, brokers, producers, consumers, and topics.
• Experience with Kafka Connect for building connectors and integrating Kafka with external systems.
• Proven ability to design and implement end-to-end streaming data pipelines that meet performance and latency requirements.