Data Engineer
Luxoft is a global leader in high-end software development.
Luxoft is looking for talents with a passion for technology & ready to create original solutions. Once on board, you are invited to expand your knowledge & skills, offering you a continuous learning experience helping you stretch your potential.
So if you’re enthusiastic by the idea of accessing cutting edge technology & innovation to make an impact, why don't you join us?
Data Engineer
Miejsce pracy: Krakow
Nr Ref.: VR-24832
Responsibilites
- Work with our stakeholders and SMEs to model the data landscape, obtain data extracts and define secure data transfer approaches
- Work closely with data scientists to solve difficult engineering and machine learning problems and produce high-quality code
- Choose and use the right analytical libraries, programming languages, and frameworks for each task
- Develop your abilities and understanding of data science methodologies and approaches
- Refactor algorithms into production-quality and operational code, libraries, APIs, and tools
- Plan and execute secure, good practice data integration strategies and approaches
- Acquire, ingest, and process data from multiple sources and systems into Big Data platforms
- Create and manage data environments in the Cloud
- Collaborate with our data scientists to map data fields to hypotheses and curate, wrangle, and prepare data for use in their advanced analytical models
- Have a strong understanding of Information Security principles to ensure compliant handling and management of proprietary and sensitive data
- This is a fantastic opportunity to be involved in end-to-end data management for cutting edge Advanced Analytics and Data Science
Requirements
- Deep and passionate knowledge of software engineering principles, practices
- Proven knowledge of object-oriented programming e.g., Java, C++ etc.
- Knowledge of at least one scripting language e.g. Python, Perl, R etc.
- Commercial project experience, including working in close-knit agile teams
- Deep knowledge of testing frameworks and libraries
- Ideally have 3+ years of relevant data engineering/ETL experience
- A proven ability in clearly communicating complex solutions
- Data security & governance expertise
- Strong experience in traditional data warehousing / ETL tools
- Experience and interest in Big Data technologies (Hadoop / Spark / NoSQL DBs)
- Experience working with Cloud technologies, Linux experience a plus
- Strong SQL experience, and proficient in one or more programming language Python / R / Java
- Exceptional attention to detail
We offer
The client is seeking a data engineer to support a machine learning initiative. We are seeking an experienced engineer with a passion for data and understanding of how to drive business value from data. The candidate will be comfortable with Big Data and Cloud computing as well as advanced analytics techniques. They will have experience in handling vast amounts of data - working on database design and development, data integration and ingestion, designing ETL architectures using a variety of ETL tools and techniques. They have a drive to iteratively implement the best possible solutions for your stakeholders and work closely with a highly skilled Data Science team.