Sr. Software Integration Backend Engineer

About the client
The client is a software company founded to address the fundamental disconnect between people and the companies they interact with every day. We give people a strong, collective voice to share experiences, inform companies, and influence change in our world.
Project Description
We are looking for a Senior Software Integration Engineer to join our team. This position is for world-class engineer who wants to take location, online and transactional data understanding to a new frontier. We need to integrate data from multiple AWS clouds, build new data classification algorithms and visualizations, publish our segments on different DMPs and DSPs and generate analytical reports.
Responsibilities

 
Design, and develop data-products, with adjoining data-pipelines, engineered to high standards of performance, efficiency, and reliability.
 
Formulate data-management strategy and data-warehouse architecture to provide single source-of-truth datasets for internal and external clients.
 
Ensure data quality, with testing on a product and pipeline level.
 
Implement automation of the data pipelines & software releases.
 
Collaborate with internal teams to gather requirements for data-products.
 
Provide some ongoing support, monitoring, and maintenance of deployed products.

Must have

 
Integration of back- and front-end modules with Rest API.
 
Build and Deployment of application on all environments. (AWS preferred, GCP ok, Azure as a last resort)
 
Professional development experience with Python
 
Experience with services like EMR & ECS on AWS (if they have AWS cloud experience. if not, no problem)
 
Experience in UNIX/Linux environments with Bash/Python scripting.
 
Experience with distributed systems: EMR, Hbase, Cassandra, and RDBMS (PostgreSQL).

Nice to have

 
Spark development experience.
 
Ruby development experience.
 
Scala development experience.
 
Experience with Scala is highly desirable.