To apply for this job you must first either login or register

Software Engineer - Data Platform

Toronto, Ontario  - Permanent



Job Description

Our client is a division of one of the worlds largest mobile commerce platforms which produces more than 30 million transactions each month, the majority of these transactions occurring on mobile apps. They started out by offering mobile recharge and utility bill payments, and today they offer a marketplace to consumers on their mobile apps.

Their scale offers a very unique set of challenges and they are innovation around data/capabilities essential to scale even higher. They work with much longer horizons and accept trial and failure as part of building the right solution. They are about solving problems that have little or no precedent. These challenges require lots creative thinking based upon a very deep understanding of how software works!

The ideal candidate is an ace problem solver and a learner at heart. You should have a very high degree of comfort in OOP, offer a flexible work schedule and you get your choice of tools (both hardware and software). Most importantly you will have the opportunity to work on tough problems with the brightest minds around you.

We get access to the most important data, blend it and act on it in near real-time to make our users and consumer happy.

Overview:
-You will expand on our data infrastructure, responsible for collecting, storing and servicing petabytes of data and services & frameworks that make data more accessible to our groups of developers, services & teams.
-Part of this includes building out ML pipelines, to extracts standard sets of features out of important datasets, and exposes them as Spark RDDs.
-You will be implementing SDKs for access of vast datasets and managing periodic computations to help keep our products and services current.
-Creating gateway services that offer low latency access to information in our Hadoop data lake.
-Utilize the latest breakthroughs in data processing technologies, to extract value out of our data.


Must Have Skills:

-Bachelor's/Masters, or a PhD in Computer Sciences/Engineering or related field
-Deep engineering background, ideally experienced with large scale data/distributed systems, housing several TBs of data
-Dedication to moving fast in the short-term, while simultaneously building for the long term
-Deep & Hands on experience building MapReduce/Spark or similar such big data pipelines/frameworks/services
-Prior experience developing foundational services at scale (eg: ML Pipelines, Relevance systems, Search services)
-Can quickly learn and be productive at new data technologies
-Can produce quality code fast, preferably Java/Scala, Go, Python, on *nix
-Excellent foundation in distributed systems concepts


Details:
Starting: ASAP
Travel: 0%
Dress Code: Casual
To apply for this job you must first either login or register