Big Data Engineer

Information about the offer
  • Offer ID: PL2735
  • Category: Database Administrator
  • Place: Warsaw, Poland
Requirements
  • Minimal level of education: Undergraduate University Education (Bc., etc)
  • Minimal experience: Between 2 and 5 years

VACANCY DESCRIPTION

This is an opportunity to work with a global consulting firm delivering IT, HR, finance, project management, and strategic business services to clients all over the world.

DUTIES

We are looking for a top-notch technology savvy specialists willing to move our projects on the new track! You will use the most advanced technology stack and have an opportunity to implement new solutions while working with top leaders in their industries. As a part of the global team you will participate in international projects based on Java and MS Azure platform.

REQUIREMENTS

* 3+ years of commercial experience in Big Data
* Experience working on Hadoop distribution systems (Cloudera/Hortonworks/MapR)
* Understanding & familiarity with Hadoop Ecosystem. Hands-on programming experience in Apache Spark using SparkSQL and Spark Streaming or Apache Storm
* Proficiency in Python or Scala programming languages
* Experience on Data Integration: Kafka, Sqoop, Nifi, Flink, Talend, Informatica, DataStage, Talend
* Experience on Data Processing and Management: HDFS, HBase, Hive, Impala, Cassandra, Mongo DB, Spark, Storm, MPP, MR, Hortonworks-Cloudera Stack
* Knowledge of data modelling tools (Power designer, Erwin, or other accepted standard tool), CI/CD Tools (Jenkins, Marvin, GIT)
* Experience in using Agile methodologies (Scrum, Kanban, etc.)
* Very good English language verbal and written communication

PREFERRED QUALIFICATIONS:
* Knowledge of big data architecture patterns [Lambda, Kappa]
* Experience in ETL on Azure/AWS/GCP cloud and Databricks
* Experience in enterprise-class solution implementations
* German or other European language would be an advantage, but not mandatory

Salary

Negotiable depending on candidate's seniority