Lead Data Engineer (Python) IRC130535
|Location:||Ukraine - Kyiv, Lviv, Mykolaiv, Kharkiv, Dnipro|
|Designation:||Lead Software Engineer|
|Skills:||Amazon AWS, AWS Glue, AWS Kinesis, Big Data, Data Warehousing, ETL, Java8, Kinesis, Python, Spark|
GlobalLogic is building an analytical platform for the client.
- gathering information from various sources
- normalizing it according to the predefined flow
- displaying it to users as a set of analytical dashboards
The gathered and processed information will let the customers make decisions regarding the business state of the investigated companies. Analytical information will help customers to predict the future state of the market.
The client provides high value analysis and support to partner companies for identification and mitigation emerging business challenges. Today the customer’s business processes are highly manual and fragmented.
The project is aimed to define and bring to life a digital platform that connects the client employees with relevant and meaningful information about their portfolio holdings, enabling insights and action.
Minimum of 5-6 years in working with Enterprise Data Warehouse technologies including Multi-Dimensional Data Modeling, Data Architectures or other work related to the construction of enterprise data assets
Experience with Big Data querying tools
Data modeling and schema design
Strong SQL programming background with the ability to troubleshoot and tune the code
Proven understanding and demonstrable implementation experience of cloud data platform technologies
Previous years of experience and a substantial understanding in
AWS data ingestion frameworks, such as Kinesis, DMS (in use)
AWS data processing (CDC,ETL) frameworks, such as EMR (in use), AWS Glue/Athena (in use), Sqoop, Spark, Zeppelin, Kinesis tools
AWS pipeline orchestration technologies, such as Data Pipeline(in use), Step Functions, and Lambda (in use)
AWS data storage engines, such as S3 (in use), HDFS (in use), Dynamo DB (in use)
AWS data access/warehousing tools, such as Athena (in use) and Redshift
Strong problem solving, troubleshooting and analysis skills
Experience with leading and mentorship of other engineers
Good knowledge of Agile Scrum
Good communication skills
English – Upper-Intermediate
Develop and manage large scale data systems and ingestion capabilities.
Support the design and development of solutions for the deployment of dashboards and reports to various stakeholders.
Work directly with the business teams to rapidly prototype analytic solutions based upon business requirements.
Architect data pipelines and ETL processes to connect with various data sources.
Manage cloud based data & analytics platform.
Deploy updates and fixes and assist technical support.
Lead the team of 5 data engineers.
Split and dedicate the workload inside the team.
What We Offer
Exciting Projects: Come take your place at the forefront of digital transformation! With clients across all industries and sectors, we offer an opportunity to participate in creating market-defining products using the latest technologies.
Collaborative Environment: Expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible opportunities and options.
Professional Development: Our dedicated Learning & Development team regularly organizes certification and technical / soft skill training to help you realize your professional goals.
Excellent Benefits: We provide our consultants with competitive compensation and benefits
Fun Perks: We want you to love where you work, which is why we host sports classes, cultural, social and team building activities such as sports competitions and end-of-year corporate parties. Our vibrant offices also include dedicated GL Zones and rooftop decks where you can drink coffee or tea with your colleagues over a game of table football or darts!
GlobalLogic is a full-lifecycle product development services leader that combines chip-to-cloud software engineering expertise and vertical industry experience to help our customers design, build, and deliver their next-generation products and digital experiences. We expertly integrate design, complex engineering, and agile delivery capabilities to deliver superior business outcomes for global brands in telecom, automotive, healthcare, technology, media and entertainment, manufacturing, and semiconductor industries.
Headquartered in Silicon Valley, GlobalLogic unites over 18,000 designers and engineers across the globe. Analysts like NASSCOM and Zinnov have recognized us for being a top company in our field, and we are consistently nominated as a preferred company by both global HR consulting firms and local boards. By creating an environment that is exciting and flexible, and by fostering growth through ongoing learning and development programs, we empower our consultants to achieve both their professional and personal goals.
At GlobalLogic, we make amazing products — and careers.