Senior Data Engineer IRC264689

Description

Our client provides collaborative payment, invoice and document automation solutions to corporations, financial institutions and banks around the world. The company’s solutions are used to streamline, automate and manage processes involving payments, invoicing, global cash management, supply chain finance and transactional documents. Organizations trust these solutions to meet their needs for cost reduction, competitive differentiation and optimization of working capital.

Serving industries such as financial services, insurance, health care, technology, communications, education, media, manufacturing and government, Bottomline provides products and services to approximately 80 of the Fortune 100 companies and 70 of the FTSE (Financial Times) 100 companies.

Our client is a participating employer in the Employment Verification (E-Verify) program EOE/AA/M/F/V/D/E-Verify Employer

Our cleint is an Equal Employment Opportunity and Affirmative Action Employer.

Requirements

We expect candidates with long experience to work with a new team and demonstrate experience on the following:

Experience with Databricks or similar
Hands-on experience with the Databricks platform or similar is helpful.
Managing delta tables, including tasks like incremental updates, compaction, and restoring versions
Proficiency in python (or other programming skills) and SQL, commonly used to create and manage data pipelines, query and run BI DWH workload on Databricks
Familiarity with other languages like Scala (common in the Spark/Databricks world), Java can also be beneficial.
Experience with Apache Spark
Understanding of Apache Spark’s architecture, data processing concepts (RDDs, DataFrames, Datasets)
Knowledge of spark-based workflows
Experience with data pipelines
Experience in designing, building, and maintaining robust and scalable ETL (Extract, Transform, Load) or ELT (Extract, Load, Transform) pipelines.
Data Understanding and Business Acumen
The ability to analyse and understand data, identify patterns, and troubleshoot data quality issues is crucial. Familiarity with data profiling techniques

Job responsibilities

• Developing postgres based central storage location as basis for long term data storage
• Developing Standing up microservices to retain data based on tenant configuration and UI to enable customers to configure their retention policy
• Creating the pipeline to transform the data from transactional database to format suited to analytical queries
• Helping pinpoint and fix issues in data quality
• Paricipating in code review sessions
• Following client’s standards to the code and data qualities

#LI-ZK1 #LI-Remote

 

What we offer

Culture of caring. At GlobalLogic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you’ll experience an inclusive culture of acceptance and belonging, where you’ll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders. 

Learning and development. We are committed to your continuous learning and development. You’ll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career at GlobalLogic. With our Career Navigator tool as just one example, GlobalLogic offers a rich array of programs, training curricula, and hands-on opportunities to grow personally and professionally.

Interesting & meaningful work. GlobalLogic is known for engineering impact for and with clients around the world. As part of our team, you’ll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what’s possible and bring new solutions to market. In the process, you’ll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today.

Balance and flexibility. We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!

High-trust organization. We are a high-trust organization where integrity is key. By joining GlobalLogic, you’re placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.