With 50 000 employees in more than 120 countries, Aon is a global provider of HR, Financial, IT and Risk Management services. That means we help companies to recruit and motivate their employees, to manage their HR and financial data, and to reduce the risks they face. In Poland we have been operating from 1992, employing today over 1000 colleagues. Our main offices are in Warsaw and Krakow.
And how is it to work with us? Our colleagues tell us a consistent message: Aon has a supportive and friendly workplace culture.
And that’s how it really is! We’re flexible, multinational and dynamic company. No formal dress code, no blame culture, no unethical behaviours. We value honesty, authenticity and can-do attitude. We work hard but we know how to have fun as well.
The Big Data Platform Admin will be responsible for Aon’s Enterprise Analytics platform administration, stability, performance, enablement of new capabilities, multi-tenant management, and making sure physical implementation matches solution architecture and fulfills solution requirements.
The role holds primary responsibility for supporting solutions on the Cloudera platform built on Aon’s AWS Virtual Private Cloud. It provides subject matter expertise on Big Data techniques and tools and contributes to the Big Data Reference Architecture. Also assists technical teams with piloting advanced platform capabilities. and with conducting POCs for further innovation and capability roll-out.
The candidate will work closely with the Enterprise Architecture team, Data Science and Analytics teams, and the Big Data Operations/Engineering Leader, within the Cloud and Enterprise Platform Services division of Aon Technology.
- “AWS based Cloudera Big Data Platform” design, system administration, performance optimization, and trouble shooting.
- Deploying and maintaining services such as Cloudera Manager, AWS services, Cloudera Navigator, Ansible Playbook, Cloudera Data Science Workbench, HDFS, SQOOP, Hive, Impala, PIG, Kafka, Kudu, Zookeeper, Spark, Hue, Yarn etc.
- Independent contributor to manage/maintain/monitor Cloudera hadoop cluster on AWS
- Capacity planning, and estimating the requirements for lowering or increasing the capacity of the hadoop cluster.
- Adding and removing nodes using cluster monitoring tools like Cloudera Manager
- Configuring the high availability nodes, and keeping a track of all the running hadoop jobs
- Develop/review detailed designs for any implementations/pilot’s/POCs to enable new workloads and addition of new technical capabilities
- Provide full visibility into the health and utilization of the Cloudera based platform through use of real-time dashboards, alerts, and other mechanisms
- Performing configuration, patching, upgrades of the Cloudera environments, and associated tools
- Manage workloads and enable workload optimization including managing resource allocation and scheduling to fulfill SLAs
- Coordinate activities with Cloud Infrastructure and other enabling IT teams and Vendors
- Minimum of 5+ years of hands-on experience with Big Data/Hadoop technologies (including Hadoop, Spark, Hive. Robust experience with Cloudera is a plus.
- Minimum of 3+ years of experience in Cloud environments (preferably AWS)
- Minimum of 3+ years working in a Big Data service delivery (or equivalent) roles focusing on the following disciplines:
- Big Data Platform Administration
- Deployment of Big Data Solution Architecture
- Analytics / Business Intelligence Tools like Tableau, PowerBI, Qlik, etc.,
- AWS S3 Creating Buckets/Tokens etc.,
- Big Data/Hadoop ecosystem experience (prefer Cloudera 5.14 or 5.15)
- Preferred:
- Experience with NoSQL/Graph databases (ex: Mongo, Couchbase, etc.)
- Experience with Ingestion/ETL tools (ex: StreamSets, Informatica BDM)
- Solid security expertise, in particular with Kerberos and Active Directory
- Hands on experience with managing solutions deployed in the Cloud, preferably on AWS
- Experience working in a Global company, working in a DevOps model is a plus
- Experience with Data Cataloging tools such as Alation, Unifi, etc.
- GDPR and general regulatory compliance experience
- Cloudera/AWS Certification
- Spotless record and strong ethos
- The best medical cover on the market with free dental care
- Generous benefits package for your wellbeing (multisport cards, insurance, vouchers, and many more!)
- Stability of employment and permanent contract after trial period
- Brand new office supporting collaboration, flexibility and activity based working
- Internal career opportunities and individual development plan
- Unique workplace culture - we value openness, honesty and authenticity, so don’t expect formal dress code nor managers hidden behind closed doors
- Lots of social events, charity actions and opportunities to integrate with colleagues