Data Engineer

We are looking for Data Engineer to join Risk & Compliance Data Science department at Danske Bank.

About the company:

Danske Bank is a Nordic bank with strong local roots and bridges to the rest of the world. For more than 145 years, they have helped people and businesses in the Nordics realise their ambitions. They want to help their customers become financially confident and help them build their lives and businesses on a solid financial foundation. They aim to create long-term value for all our stakeholders – their customers, shareholders and the societies they are part of – and our vision is to be recognised as the most trusted financial partner.

Assignment description

You will become a part of the Data Engineering CoE working in the Risk & Compliance Advanced Analytics department. The focus will be to build data pipelines for the Risk & Compliance models developed by the Data Scientists. The purpose of Risk & Compliance Data Science initiative is to use Data Science to take Compliance and Risk Management to the next level. The project is seeking a contractor to speed up the deliveries for developed solutions in various business segments.

Responsibilities:

Contractors will be part of the Commercial Analytics squad working in multiple countries. The main responsibility is to

1. - Help deploy and operate prioritized models to PROD

2. - Educate CoE in DE and MLOps best practices and help draw up internal guidelines

3. - Assist in pipeline foundation development or tailoring to ACA CoE needs together with the infrastructure department:

a. Data pipelines

b. CI/CD

c. Scheduling

d. Monitoring

Contractors will be part of the Risk & Compliance department working in multiple countries. The main responsibility is to

1. - Educate CoE in DE best practices and help draw up internal guidelines

2. - Assist in data pipeline development tailoring to the Risk & Compliance CoE needs together with the infrastructure department:

a. Data pipelines

b. Scheduling

c. Monitoring

All this to ensure the Risk & Compliance Advanced Analytics department reaches its goals in 2021. All tasks will be solved as part of multifunctional DevOps squads consisting of broad capabilities delivering end to end Data Science solutions. You will therefore be working closely with experienced Data Scientists and Machine Learning Operations Engineers as well as the business units who are consuming the data science services.

Requirements:

- Hadoop Ecosystem (Hive, NoSQL, HDFS)

- Database fundamentals including MSSQL

- Database Performance tuning and Schema design

- Workflow orchestration using AirFlow or similar

- Linux/Bash - Version control (Git/Bitbucket/DVC)

- Python (pandas, dicts, lists, PySpark)

- Common Data Formats (JSON, CSV, HDFS, Hbase, Parquet)