Job Search

We can help you build an exceptional career

741 Open Positions

741 Open Positions

Data Engg Lead – Principal Engineer i IRC216550

Job IRC216550
Location India - Noida, Pune
Designation Consultant
Experience 10-15 years
Function Engineering
Skills Azure, Azure Data Lake Store, Azure Datawarehouse, Big Data, Databricks, Kafka Streams, MongoDB, Python, Scala
Work Model: Hybrid


Same as Responsibilities


Bachelor’s Degree in Computer Science, Data Science, Engineering, or a related field; or equivalent experience.
5 to 8 years of experience in data engineering, with specific expertise in big data platforms and technologies.
Proficiency in Spring Framework / Java 8
Proficiency in Apache Scala or Python programming languages.
Experience with Kafka Streaming / Confluent
Experience with MongoDB
Experience with Azure Cloud services, Azure Databricks, Delta Lake, and Azure Data Factory.
Experience with Database Systems such as Databricks SQL or Snowflake
Experience with Linux/Unix Systems and Scripting
Experience with Version Control Systems, such as Azure DevOps.
Knowledge of Spark and Apache open-source technologies
Willingness to learn and engage in on-premises data center technology as required such as Yellowbrick, Informatica ETL, and Autosys.
Capable of working in a high-performance, agile scrum environment, actively contributing to various projects, and participating in development sprints.
Strong ability to collaborate across departments and communicate technical concepts effectively.
Possess excellent communication skills in English, essential for discussing technical requirements, presenting design and feature demos in sprints, and effectively conveying developed solutions to stakeholders during scrum activities.
Able to establish and manage system performance metrics, focusing on rapid issue detection and effective problem resolution.

Job Responsibilities

Lead the development and integration of data delivery systems, focusing on enhancing operational efficiency and expanding into new markets through innovative monetization models.
Offer technical expertise in troubleshooting and resolving issues within data delivery projects, ensuring high-quality support for new client needs through effective proof of concept execution.
Development and automation of personalized retail measurement algorithms and projects, enhancing data-driven insights from shopping behaviors and retail media scorecards.
Collaborate with Azure DevOps for feature releases and documentation, and work with Cloud Engineering on infrastructure and security, ensuring project efficiency and security.
Design and implement user interfaces and data connectors for seamless data exchange between Catalina systems and external clients.
Maintain and enhance the data delivery ecosystem, focusing on process monitoring, troubleshooting, data readiness, and data quality for ad hoc reporting and optimization.
Develop Apache Scala/Spark-based Databricks jobs, orchestrated through Microsoft Azure Data Factory, to support data processing and analytics.
Optimize new and existing Databricks jobs and Delta tables to reduce operational costs and improve job performance.
Utilize DataFrame or PySpark operations to extract data from Azure Delta Lake, generating insightful reports that inform business decisions and client needs.
Collaborate across departments to gather requirements, troubleshoot issues, and design system enhancements, fostering an Agile Scrum culture.
Automate front-end reporting capabilities, enabling business users like sales or analytics teams to create reports through a user-friendly interface.
Collaborate with the Support team to address and resolve complex issues they identify, leveraging your expertise to maintain system integrity and enhance performance upon escalation.
Automate the generation of retail media scorecards, facilitating end-of-year ROI assessments for clients and supporting contract renewal discussions.
Provide technical leadership and mentorship to junior data engineers, guiding them in best practices and fostering their growth within an Agile development framework.

We Offer

Exciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.

Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!

Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.

Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.

Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.

Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!

About GlobalLogic

GlobalLogic is a leader in digital engineering. We help brands across the globe design and build innovative products, platforms, and digital experiences for the modern world. By integrating experience design, complex engineering, and data expertise—we help our clients imagine what’s possible, and accelerate their transition into tomorrow’s digital businesses. Headquartered in Silicon Valley, GlobalLogic operates design studios and engineering centers around the world, extending our deep expertise to customers in the automotive, communications, financial services, healthcare and life sciences, manufacturing, media and entertainment, semiconductor, and technology industries. GlobalLogic is a Hitachi Group Company operating under Hitachi, Ltd. (TSE: 6501) which contributes to a sustainable society with a higher quality of life by driving innovation through data and technology as the Social Innovation Business.

Apply Now

Attach your file here or browse
Only .docx, .rtf, .pdf formats allowed to a max size of 5 MB.
  • URL copied!