The Lead Data Engineer is responsible for overseeing a team of data engineers to design, build, and maintain data pipelines and infrastructure. They will lead efforts to improve data quality, reliability, and efficiency across the organization. This role requires strong technical expertise in database systems, ETL processes, and data modeling.

Skills

• Azure SQL
• Azure Data Factory
• Azure Data Lake
• Azure Databricks
• Azure Synapse
• Snowflake
• BigQuery
• T-SQL
• DBT
• ETL/ELT
• PySpark
• Data Warehousing
• Data analytics
• Data Visualization

Requirements

• Job Role Lead Data Engineer
• Job Type Full Time
• Workplace Type Onsite
• Industry Software Development

Secondary locations

About

Not provided

Responsibilities

• Lead and manage the entire offshore data engineering team, providing guidance, mentorship, and performance management.
• Foster a collaborative and high-performing team environment.
• Oversee resource allocation, project planning, and task prioritization.
• Conduct regular team meetings and provide progress updates to stakeholders.
• Design and implement effective database solutions and data models to store and retrieve company data.
• Examine and identify database structural necessities by evaluating client operations, applications, and programming requirements.
• Assess database implementation procedures to ensure compliance with internal and external regulations.
• Install and organize information systems to guarantee company functionality.
• Prepare accurate database design and architecture reports for management and executive teams.
• Oversee the migration of data from legacy systems to new solutions.
• Monitor system performance by performing regular tests, troubleshooting, and integrating new features.
• Recommend solutions to improve new and existing database systems.
• Design and implement scalable and efficient ETL/ELT processes using Azure Data Factory, Databricks, and other relevant tools.
• Build and maintain data warehouses and data lakes using Azure Synapse, Snowflake, BigQuery, and Azure Data Lake.
• Develop and optimize data pipelines for data ingestion, transformation, and loading.
• Implement data quality checks and validation processes.
• Support data analytics initiatives by providing access to reliable and accurate data.
• Develop data visualizations and dashboards using Power BI and Tableau.
• Collaborate with data scientists and business analysts to translate business requirements into technical solutions.
• Educate staff members through training and individual support.
• Work within an Agile Scrum framework.
• Utilize IT Service Management best practices.
• Provide Techno-Functional Management.

Other Requirements

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
• Proven experience leading and managing data engineering teams.
• Extensive experience in designing and implementing data solutions on Azure and other cloud platforms.
• Strong understanding of data warehousing, data modeling, and ETL/ELT concepts.
• Proficiency in SQL and scripting languages (Python, PySpark).
• Excellent communication, leadership, and problem-solving skills.
• Proven experience in client facing roles.
  

Good to have

Not provided

About the Company

AppLogiQ stands at the forefront of Digital Transformation IT services, seamlessly integrating innovative technology with unmatched expertise to create solutions that propel business growth. We excel in transforming visionary ideas into tangible digital forms; AppLogiQ has successfully delivered over 100+ projects for more than 60 customers. Our expertise extends to harnessing next-generation technologies, including Telecom, Blockchain, Metaverse, Augmented and Virtual Reality, Artificial Intelligence, comprehensive Application Services, Design, Marketing, and cloud solutions. This enables us to offer end-to-end digital transformation services to our worldwide clientele. AppLogiQ also develops proprietary products that cater to specific industry needs. LeadsynQ, our advanced LRM tool, streamlines lead management, while ShopQ, is a versatile e-commerce No-code platform that offers businesses the tools they need to create, manage, and grow their online stores effortlessly. These products exemplify our commitment to innovation and ability to create versatile digital solutions. In recognition of our relentless pursuit of excellence and innovation in the digital sphere. AppLogiQ was awarded the title of the most promising IT services company in 2023 by India5000. This award underscores our dedication to delivering cutting-edge solutions and our vision of leading the digital transformation journey for businesses around the globe.