Data Engineer Consultant - StreamSets | Kafka
REPORTS TO GTM Data Platform & Engineering
SALARY Dependent on Experience
The cloud & data integration consultant can work both independently or as part of a broader team to deliver modern data integration solutions for our clients. Typical projects can include:
- Implementation of API centric integration solutions
- Development of data ingestion pipelines
- Implementation of data cleansing and data quality improvements as part of an integration solution
- Designing the right implementation solution to meet a client’s requirements
- Design and implementation of data streaming solutions
In addition, you will be expected to support the growth of the company by contributing to our knowledge base and IP, managing and mentoring junior consultants, and supporting sales and bid work.
Must have skills and competencies
- Previous experience in delivering Data Ingestion Projects
- Previous experience working with Kafka including administration and management of clusters
- Proficiency in multiple programming languages including - Java, Python and SQL
- Previous Data Delivery experience and knowledge of working practices
- Previous experience of delivering in Agile
Nice to have skills and competencies
- Enterprise integration platforms and patterns
- Exposure to modern cloud based data solutions including
- Streamsets
- Databricks
- Azure Synapse
- AWS Redshift
- Knowledge of enterprise applications and how to integrate with them, including SAP, SFDC and others
- Knowledge of modern delivery techniques including DevOps and Micro Services
- Certification in Azure and AWS
Loading