DAT-013 Senior Data Engineer

Canada-wide Remote

Our Client is building the leading B2B platform for the under-the-radar but massive commercial services industry. Their flagship product, provides rich data on every commercial building in the US (~63M properties) and workflow software to make this data actionable. They’re scaling the team to meet the demands of our growing customer base, ranging from small-medium sized businesses to larger enterprises, such as Siemens and Carrier.

The Data Opportunity Because data is core to our product, your role is central to our entire business. Your data features in the product frequently close massive deals and drive best-in-class retention. Every customer experiences your improvements, in prod, immediately – this is not an internal BI role.

From an engineering perspective, every commercial property means massive data sets – and demanding performance and architecture requirements for your features to be put through. Geospatial data often requires GIS techniques to wrangle datasets – something different than the average SQL join. Data on virtually every commercial property in the US means a chance to see the country by way of satellite imagery, property boundaries, and several hundred other data elements we have already developed.

The Role We are looking for an experienced Data Engineer / Data Architect to build scalable platforms that enable efficient data movement across various sources, sinks, and support continuous data integration and processing with external enterprise systems via secure APIs and connectors.

You will have a chance to:

  • Design and implement reusable solutions and architectures for data sharing and processing use cases
  • Support and improve our multi-tenant data pipeline, processes, infrastructure, and stack
  • Drive end-to-end performance, scaling, observability, and monitoring of our platforms
  • Create data governance models, including assets, relationships, domains, and communities
  • Work in the heart of a business with multiple partner teams to build cross-functional customer solutions

You have the following qualifications:

  • Bachelor’s degree in Computer Science or related technical field or equivalent practical experience
  • 5+ years of software backend/data engineering experience, including familiarity with data modeling, ETL, schema and system design, roadmap planning, batch processing, implementation, maintenance, and documentation
  • Professional development experience in languages such as Python, Scala, Java, Go, etc.
  • Experience with large-scale distributed storage and database systems (e.g. Postgres, ElasticSearch, Cassandra, Hadoop, etc)
  • Sound knowledge about database concepts such as transactions, indexing, concurrency
  • Effective communicator; able to help drive data engineering roadmap and keep stakeholders updated

It would be nice if you have:

  • Masters or Ph.D. in Computer Science or related field
  • Experience building geospatial services and datasets, such as maps data
  • Hands-on experience building Spark applications or similar Big Data pipelines / frameworks / services (e.g. Hadoop, Hive, Kafka, Presto, Beam, Parquet, Avro etc.)
  • Familiarity with API integrations and development on respective CRM platforms
  • Understanding of data science & machine learning use cases