Seeking a Senior Data Engineer with 8+ years of experience in designing and developing  streaming data pipelines. Must have strong expertise in at least three of Kafka, Flink, Spark, and Scala, with proven project implementation. Experience with AWS services and exposure to Databricks, Snowflake, or similar data warehouse technologies is desirable.

Skills

• Kafka
• Flink
• Apache Spark
• Scala
• Databricks
• Snowflake
• Kinesis
• Lambda
• Python
• Java
• Docker
• Kubernetes

Requirements

• Job Role Senior Data Engineer
• Job Type Full Time
• Workplace Type Onsite
• Industry Information Technology & Services

Secondary locations

About

Not provided

Responsibilities

• Design and develop scalable, low-latency streaming data pipelines using Kafka, Flink, or Spark.
• Build and operate cloud-native data systems on AWS (Kinesis, Lambda, EMR, EKS, S3).
• Ensure data quality, monitoring, and reliability across real-time pipelines in production
• Write clean, efficient code in Scala, Python, or Java and deploy via pipelines with Docker/Kubernetes.
• Collaborate with teams to deliver secure, high-performance data solutions and drive operational excellence.

Other Requirements

• 8+year experience in design and development of streaming data pipelines.
• Experience to deal with large stream volumes.
• Implementation experience ( atleast couple of projects ) in Kafka/Flink/Spark/Scala. Very good experience on atleast 3 out of the 4 technologies
• Desirable experience in Databricks, Snowflake or any data warehouse technologies.
• Strong Experience using AWS native services.
• 5+ years of relevant experience in development and operation in production of Cloud native data streaming data systems (with an emphasis on scalability, robustness, data delivery low latency and data privacy and quality control)
• 5+ years’ experience working in Cloud native real-time streaming data ecosystem such as Spark, Flink, Kinesis, Lambda, Kafka, EMR/EKS platform, Lakehouse platform (i.e Delta.io, Databricks)
• 5+ years of experience in developing optimizing AWS data system architecture: Infrastructure as Code, integration and deployment automation, security.
• 5+ years of experience in ensuring operation reliability of cloud native data system in production.
• 5+ years in relational database concepts with a solid knowledge of SQL, SQL Tuning, Big Data NoSQL technologies
• 5+ years’ experience with languages like Spark-Scala, Py-Spark and /or Python, Java
• Experience with development and deployment of containerized application using Docker, Kubernetes, Helm
• Experience in building systems that monitor data losses and data quality control.
• Demonstrated knowledge of data structures and algorithms.
• Experience in designing foundations of Operational excellence and implementing.
• Curiosity and passion to learn with a strong bias to action.

Good to have

Not provided

About the Company

We at Tamcherry - Zaportiv delivers multiple types of tailored solutions to our customers depending on their requirements. The perfect blend of mature processes, flexible delivery models, effective project management, broad technology, and domain expertise enable Tamcherry ZAPORTIV to provide best-in-class delivery to our customers We boast of an eminent lineup of well-seasoned and vetted professionals who have the real potential to support your business growth