- Industry: Finance / Banking
- Business trips: Occasional
- Remote work: possible, but person should expect a couple of days in the beginning onsite, and then whenever there might be issues that needs to be resolved with laptop or equipment.
- Project language: English, Polish
- Renumeration: 118 - 150 PLN/h + VAT - depending on expirience
- Project length: till 31.12.2020 + possible extensions
Migration of the data pipelines from Cloudera 5 to Cloudera 6.
DATADB is an application with a large variety of data pipelines developed on an older version of Cloudera
throughout a period of 5 years. The business cases supported by the application is mostly commercial activities, but also regulatory. For example, customer insights, KYC, and many more uses cases.
As the current cluster is running out of lease at the beginning of next year, the client is under time pressure to ensure migration is completed with and aggressive timeline at end of this year. PROJECT RESPONSIBILITIES:
- Making sure the current pipeline which is running in Cloudera 5 environment will also has to be running in Cloudera 6 environment;
- Testing the existing code in Cloudera 6 test environment,
- If bugs are identified, they would need a fix by development of the respective components and deploy the job in production environment.
- Required experience with: Oozie, Sqoop, Bash, and Hive;
- Nice to have: Scala and Spark.
- Very good communication skills in English
- Challenging international projects in a Scandinavian business culture.
- Transparently built relations based on trust and fair play.
- Benefits: Medicover card, Multisport card.
- Internal reference bonus.
Min. 5 years of professional IT experience.