Data / Services Engineer

• 50%: Writing and deploying stored procedures and other scripts
• 25%: Data modelling and design
• 10%: Production support
• 10%: Architecture and software development meetings
• 5%: Other

Mandatory:

• Node.js/JavaScript Express programming experience
• Advanced knowledge of MongoDB (scaling out, sharding, optimization), and the ability to determine when it's best to choose a noSQL solution over a SQL solution
• Knowledge of SQL, including implementation of tables, views, stored procedures, and functions.
• 3+ years designing, implementing, and operational data store, data mart and business intelligence solutions
• Experience architecting high-volume solutions
• Experience working with MapReduce for large-scale analysis
• Experience working with different MQ technologies
• Experience in leveraging Redis/Memcached clusters and balancing in memory data with NoSql data
• Experience working with large data warehouses (10+ billion entries) and high-throughput transactional systems (hundreds of millions of daily events)
• Experience working with enterprise data: business analysis, data modeling, source analysis, mapping, cleansing, transforming, enriching, loading, validating, mining, reporting, and archiving
• Experience working in Linux/Unix (Ubuntu)
• Experience working in a cloud environment, preferably Amazon Web Services

Nice to see:

• Strong knowledge in data processing languages, preferred Golang
• Knowledge of database internals; partitioning; indexes; star schema optimization; parallel queries
• Experience working with Erwin or other data modeling tools
• Experience with web analytics, high-volume online transaction systems and high-frequency trading systems is highly desirable
• Previous work at Adtech company is a huge plus
• Work in an Agile/Scrum environment
• Experience working with git
• Experience working with Jenkins, Chef and Puppet

Our client is a US-based Big Data start-up that's building a revolutionary platform that will change how data is exchanged on the Internet. They empower digital publishers, e-commerce sites, and brand marketers to understand and control how third-party data collectors interact with their on-line audiences. Imagine having real-time visibility into browser data across hundreds of millions of monthly visitors and being able to remotely control in real-time how third-party JavaScript tags function. Imagine the flood of billions of daily transactions that need to be processed to make sense of all this. Finally imagine the diversity of software engineering and technology operations challenges involved -- no boring back-office IT projects here.

We're looking for a back-end software engineer to work as part of our services and data teams. This engineer will help to architect and maintain our data collection and processing systems, which are based on MongoDB, Kafka, and Redis/Memcached. If you've worked in a digital publishing, ad technology, or online analytics environment, you'd be a particularly good fit.