Job Search
Senior Data Engineer IRC150827
| Job: | IRC150827 |
| Location: | Poland |
| Designation: | Consultant |
| Experience: | 5-10 years |
| Function: | Engineering |
| Skills: | Azure Blob Storage, Big Data Processing, Cloud Infrastructure, Continuous Integration, Microsoft Azure |
| Remote | Yes |
Description:
Client’s product helps leverage customer data via the most sophisticated application of new technologies to:
• Understand customer behavior at a level previously not possible.
• Identify the precise effect of advertising and promotions.
• Generate real time profiles of customer segments.
• Uncover the correlation between team member performance and customer loyalty.
Business domain: data processing.
Requirements:
-
Experience in IT for more than 5 years;
-
Excellent knowledge in Computer Science, Computing Theory, Data Engineering:
-
Data Engineering, Big Data;
-
Database theory (RDBMS, NoSQL);
-
Data structures;
-
Architectural, Enterprise Patterns;
-
Practical commercial experience with:
-
Creation Data Solution on some of this technology: Spark (Scala or Python), Azure Ecosystem, Kafka or equivalent PaaS like Confluent; (3+ years of experience);
-
RDBMS Systems (Netezza, Oracle, SQL Server, DB2) or even better Snowflake/Synapse/BigData;
-
Linux/Unix Systems, scripting;
-
NoSQL (e.g. Azure Cosmos DB);
-
Version control systems (GIT);
-
Cloud computing platforms (Microsoft Azure);
-
develop/test and deploy data solutions (mid to high complexity);
-
work automation(Including CI/CD practices such as Feature Branches, Unit Test automation and Release Cycles);
-
Continuous Integration tools (e.g. Gitlab Pipeline, Jenkins, TeamCity, Bamboo);
-
Experience with:
-
Troubleshooting, profiling and debugging applications;
-
Creation software architecture and design of complex applications, platforms, microservices solutions;
-
Agile software processes and technologies;
-
Code Review process;
-
Refactoring process;
-
Upper-Intermediate English;
-
Certifications on:
-
Cloud computing platforms (Microsoft Azure);
-
SQL Experience is preferred but not needed if they can operate Spark;
-
Understanding of orchestration and containerisation (Docker, Kubernetes);
-
Practical commercial experience with Kubernetes (especially AKS) on production.
Requirements
Desirable
Preferences:
Databricks, Azure Datawarehouse, Kubernetes
Job Responsibilities:
-
Develop Data Platform from scratch using a modern development environment and toolset (Azure tool suite: Azure Data Lake, Azure Databricks, Azure Devops; Spark/Python-Scala) resulting in stable and high-quality code within deadlines, following established processes.
-
Develop and maintain optimal data pipeline architecture;
-
Maintain in-depth knowledge of the data ecosystem and trends; be a subject matter expert and thought leader;
-
Taking part in the decision-making process in design, solution development and code review;
-
Working in an international distributed team;
-
Communicate with CTO, Architect, PM, software developers, data engineers, automation QA’s and other colleagues and stakeholders;
-
Delivering the product roadmap and plannings, create estimations.
What We Offer
Exciting Projects: With clients across all industries and sectors, we offer an opportunity to work on market-defining products using the latest technologies.
Collaborative Environment: You can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules.
Professional Development: We develop paths suited to your individual talents through international knowledge exchanges and professional certification opportunities.
Excellent Benefits: We provide our employees with private medical care, sports facilities cards, group life insurance, travel insurance, relocation package, food subsidies and cultural activities.
Fun Perks: We want you to feel comfortable in your work, which is why we create good working environment with relax zones, host social and teambuilding activities and stock our kitchen with delicious teas and coffees!