LOCATION: Lublin
At intive we believe that emerging digital technologies make life easier. Therefore with more than 1000 people on board we are helping forward-thinking enterprises to design and build smart applications, software solutions and turn ideas into digital reality all around the world.
To achieve best results we are constantly challenging assumptions and establish approaches following our company motto - never settle.
Senior Big Data Developer
Ref. No.: BIGDATA/SDEV/LUB/0119/PR
You are a good match if you:
- Have at least 2 years experience building Big Data solutions using the Hadoop ecosystem (Hadoop, HDFS,MR framework, YARN, Apache Spark, Hive QL, Sqoop etc.)
- Have experience with Spark
- Are proficient in a programming language like Java or Python or Scala
- Have knowledge and experience in Unix environment & Shell scripting
- Have RDMS DB background (SQL Server/Oracle and/or DB2) - at least 2 years
- Have experience in importing and exporting the data using Sqoop from HDFS to Relational Database systems and vice-versa.
- Have knowledge of workflow/schedulers like Oozie or any other scheduling tool
You get extra points for:
- Coordinating the movement of data from original data sources into noSQL data lakes and cloud environments
- Hands-on experience with Talend used in conjunction of Hadoop MapReduce/Spark/Hive.
- Solid understanding of different file formats and data serialization formats such as ProtoBuf, Avro or JSON.
- Experience with Google cloud platform (Google BigQuery)
- Experience in IDE framework like Hue, Jupyter , Zepplin
You will be responsible for:
- Solving Data Engineering and Data Science problems
- Development of data ingestion pipelines
- Contribution to Big Data Team across Poland