BigData DevOps Engineer
[online recruitment]
[online recruitment]
Location: woj.
łódzkie
Reference number: VR-59988
Project Description:
Driven by regulatory demand, our client, a top tier investment bank has to establish Global Operational Continuity in Resolution (OCIR) framework across the existing fragmented local solutions, harmonizing taxonomy, processes and procedures and increasing transparency on dependencies and risks in order to ensure and support going concern during resolution or stress situation.
Objective of our project is to provide a global analytics and MI solution using approved data sources, standardize and improve data quality. This global solution has to allow flexible configuration of regulatory rules to enable decommissioning of local fragmented solutions as well as flexible data models, business rules, documentation standards to ensure that capabilities and solutions are scalable, transparent and facilitate:
- Restructuring - timely execution of a bank's recovery and resolution plan
- Reacting to ad-hoc regulatory requests or rules changes
- Adaptation to a long-term roadmap
Responsibilities
- Responsible for infrastructure management for the team (DEV, QA, UAT and PROD environments)
- Develop Python or Bash scripts to automate deployment process
- Deploying configurations and application in each environment
- Debug critical problems on production environment with minimal turnaround time
- Responsible for in-house monitoring and maintenance of software
- Run DEV, QA, UAT and PROD data pipelines
- Ingesting data in HDFS using Sqoop, lftp
- Creating and scheduling tasks using Airflow
- Setting up Kerberized cluster
- Perform common SCM practices such as branching, tagging and code merge
- Managing and reviewing HDFS log files
- Resolving issues in Cluster performance, SPARK and HIVE jobs
Skills
- Minimum 5 years of experience in a similar role
- Linux knowledge, bash scripting
- Knowledge of Python and automation tools like Ansible or Salt
- 2+ years of hands on experience with Apache Hadoop Ecosystem (Cloudera)
- Docker, git, svn
- Good interpersonal skills, able communicator and team player, highly autonomous
- Clear written communication skills when documenting processes and features and communicating via e-mail
- Outstanding problem solving skills
- Comfortable working in an Agile environment
Our offer
Career and Professional Development
- International projects for clients all over the world
- Competitive salary
- Individual development plan
- Managerial Targeted Training programs
- BRIDGE Mentoring Program
- Luxoft Training Center
- Language Classes
- Self-learning online library
- Global Relocation Program
- Internal Mobility (a chance to gain experience in varied projects and technologies)
- Professional communities for knowledge-sharing (Agile, Tech, Business)
- Group Life Insurance
- Travel Insurance
- Private Healthcare (dental care, unlimited consultations of specialist physicians)
- Medical costs reimbursement for employees
- Benefit Program (Cafeteria and Multisport Card)
- LuxGood Program (a wide range of health and well-being initiatives)
- After-hours groups (sport, trips, board games, cultural activities)
- Company and Team events
- BeLux - discount offers program (banking, car leasing, other)
- Convenient locations in modern offices
Career and Professional Development
- International projects for clients all over the world
- Competitive salary
- Individual development plan
- Managerial Targeted Training programs
- BRIDGE Mentoring Program
- Luxoft Training Center
- Language Classes
- Self-learning online library
- Global Relocation Program
- Internal Mobility (a chance to gain experience in varied projects and technologies)
- Professional communities for knowledge-sharing (Agile, Tech, Business)
Well-being
- Group Life Insurance
- Travel Insurance
- Private Healthcare (dental care, unlimited consultations of specialist physicians)
- Medical costs reimbursement for employees
- Benefit Program (Cafeteria and Multisport Card)
Work-Life Balance
- LuxGood Program (a wide range of health and well-being initiatives)
- After-hours groups (sport, trips, board games, cultural activities)
- Company and Team events
- BeLux - discount offers program (banking, car leasing, other)
- Convenient locations in modern offices
Please send your CV with consent for processing your personal data for recruitment purposes using the below button
APPLY