Our Client, an international online and mobile services producer, is opening office in Krakow. The center will hire about 150 IT Specialists for new projects and creating new products. Innovative Company with headquarters based in London and divisions worldwide - with strong position on the market, works with new technologies in end-to-end Scrum methodology with best infrastructure and emerging technologies. If you are looking for the fast career development and extended learning opportunities, apply for the position of:
Big Data Systems Engineer
Kraków
Nr ref.: 5332
Requirements:
- Production experience of implementing and supporting either Hadoop or Splunk in an Enterprise environment
- A Basic understanding of data governance concepts, data science and analytics, MapReduce and transactional analysis
- Experience with relational databases such as PostgreSQL, MySQL and Oracle
- Creation and maintenance of shell and system scripts
- Hadoop and its ecosystem (HDFS, Kafka, Ambari, ZooKeeper, YARN, HBase, Hive, Pig, Oozie, Storm etc.)
- Configuration management and provisioning with Puppet
- NoSQL DBA experience – MongoDB, Vertica
- APM monitoring tool AppDynamics
- Splunk 6.x and / or Hadoop in a large distributed enterprise deployment utilizing clustering and replication
- Managing Splunk servers and forwarders with Splunk Deployment Server
- Splunk index lifecycle management from hot to frozen
- Developing Splunk apps and dashboards
- Developing custom search commands in Python
- Demonstrable problem solving techniques and creative thinking
- Excellent verbal and written communication skills in English
- Scripting with Python and Bash
- Strong working knowledge of at least one system monitoring and reporting tool such as OpenView, Nagios, Zabbix, Cacti, Munin etc.
- Solid understanding of network principles and tools
- Proven ability and aptitude to learn and implement new and appropriate open source technologies
- Basic Linux systems administration and troubleshooting
- Basic software development with PHP, Java, Python or Ruby
- Development tools such as Subversion, Git
- Knowledge and experience with LDAP & AD authentication integration
- Analytical, statistical and mathematical competencies
Responsibilities:
- Operational Support and development of Company’s Data infrastructure initially consisting of Splunk and Hadoop (Hortonworks Data Platform) on Linux
- Meet HA requirements using clustering and replication technologies
- Monitoring systems for availability, performance and capacity; working with the infrastructure and development teams on upgrades and maintenance
- Securing systems according to company policy and policing data access through the platforms
- Meeting compliance requirements for protecting sensitive data in the data platforms
- Creation and maintenance of documentation for Data platform components and procedures
- Training and development using the data platforms
- Splunk index lifecycle management
- Developing Splunk apps and dashboards
- Developing custom search commands in Python
- Integrations with external data sources including DB Connect. Hunk, NoSQL
We offer:
- A possibility of taking part in setting up a new IT department
- Participation in interesting and challenging projects in global structures
- Opportunity to develop and broaden technical skills
- Attractive salary, bonuses and benefits package
- Pleasant working atmosphere