Big Data Engineer

Информация за работата
  • Реф. номер: PL2735
  • Категория: Database Administrator
  • Place: Warsaw, Poland
Изисквания
  • Minimal level of education: Undergraduate University Education (Bc., etc)
  • Минимален опит: Between 2 and 5 years

ОПИСАНИЕ НА РАБОТАТА

This is an opportunity to work with a global consulting firm delivering IT, HR, finance, project management, and strategic business services to clients all over the world.

РАБОТНИ ЗАДЪЛЖЕНИЯ

We are looking for a top-notch technology savvy specialists willing to move our projects on the new track! You will use the most advanced technology stack and have an opportunity to implement new solutions while working with top leaders in their industries. As a part of the global team you will participate in international projects based on Java and MS Azure platform.

ИЗИСКВАНИЯ ЗА РАБОТАТА

* 3+ years of commercial experience in Big Data
* Experience working on Hadoop distribution systems (Cloudera/Hortonworks/MapR)
* Understanding & familiarity with Hadoop Ecosystem. Hands-on programming experience in Apache Spark using SparkSQL and Spark Streaming or Apache Storm
* Proficiency in Python or Scala programming languages
* Experience on Data Integration: Kafka, Sqoop, Nifi, Flink, Talend, Informatica, DataStage, Talend
* Experience on Data Processing and Management: HDFS, HBase, Hive, Impala, Cassandra, Mongo DB, Spark, Storm, MPP, MR, Hortonworks-Cloudera Stack
* Knowledge of data modelling tools (Power designer, Erwin, or other accepted standard tool), CI/CD Tools (Jenkins, Marvin, GIT)
* Experience in using Agile methodologies (Scrum, Kanban, etc.)
* Very good English language verbal and written communication

PREFERRED QUALIFICATIONS:
* Knowledge of big data architecture patterns [Lambda, Kappa]
* Experience in ETL on Azure/AWS/GCP cloud and Databricks
* Experience in enterprise-class solution implementations
* German or other European language would be an advantage, but not mandatory

Salary

Negotiable depending on candidate's seniority