Senior Data Engineer

Home

People

ID : 1886

Education level : Diploma, Bachelor's degree, Master's degree

Work experience level : Intermediate- (2-4 year experience)

Work experience in total : Years

Job type : Online

Job time : Maandelijks

Last date of registration :

2023-02-07

I am an experienced Data Engineer, Data Science enthusiast, Technical Business Analyst and part-time lecturer with a passion for Artificial intelligence, Machine Learning, Deep Learning and Natural Language Processing. I am an excellent team player and confident to adapt to any environment maintaining my positive personality.

Senior Data Engineer - Arimac Lanka PVT LTD. (December 2020 – Present)

Working with stakeholders, data architects and data owners to implement data management process, business rules, business decisions, policy, and analyse gap as part of the organization’s data governance requirements.
Leading teams of 3-4 data engineers & associate data engineers in the project building and delivery process.
Exploring suitable options, design and create data pipelines (data lake/ data warehouses) for specific analytical solutions
Support maintenance, bug fixing and performance analysis along data pipelines.
Build and manage cloud data services (Microsoft Azure services).
Proposed, designed, and developed the Data warehouse & Data marts for reporting requirements of the Payment Panel 3 project for the VISA United States.
Currently leading the Data team of the project Payment Panel 3 of VISA United States.

Data Engineer - Arimac Lanka PVT LTD. - (December 2020 – Present)

Designed, developed, managed and optimized Data Warehouses/Data Marts
Designed and developed interactive reports/dashboards based on customer requirements using BI tools like Power BI and SPSS custom tables.
Data platform migrations – from on-prem to cloud and vice versa
Created technical documents for BI and Data solutions
Conducted regular research on new technologies & ensure knowledge transfer within the team
Handled the Data extraction & transformation process of the Payment Panel 3 project for the VISA United States
Created simple and complex tabular format business insight reports for VISA with SPSS custom tables.
Developed Azure synapse SQL pool as the Data warehouse for the project Payment Panel 3 with multiple fact and dimension tables.

Associate Consultant in Data Engineering - Altria Consulting PVT LTD. (August 2019 –November 2020)

Consultant in Data Engineering
Designed and implemented Data warehouses (Clients – LB Finance, Hutch Mobile, Dialog Axiata, Hemas, IWMI)
Developed ETL flows with SSIS
Built reports with SQL Server Reporting Services (SSRS)
Developed ETL pipelines with Azure Cloud services (Azure Data Factory)
Implemented Machine Learning and Deep Learning algorithms.
Data Visualization with Power BI

Trainee Associate Consultant in Data Engineering - Altria Consulting PVT LTD. (August 2019 –November 2020)

Developed Stored procedures for data loading
Bug fixing in SSRS reports
Data Visualization with SSRS and Power

Lecturer - Academy of Multimedia and Design (January 2022 – Present)

Lecturer for Artificial Intelligence Strategy for Business Leaders Module
Conducting Visiting Lectures on Artificial Intelligence which cover the topics of Machine Learning, Deep Learning and Natural Language Processing.
Consulting the academic staff for degree module revisions and evaluations.

Data extraction and organization (ETL)
Data Warehouse Development
Big Data Engineering
Machine Learning
Deep Learning
Natural Language Processing
Artificial Intelligence
User Experience Design
Research and Development
Business Requirement Analysis
Languages
- Python
- Pyspark
- R
- HIVE
- PIG
Database
- SQL (MySQL, Postgres)
- NoSQL (MongoDB)
Cloud
- Google Clou
- MS Azure
- AWS
- Heroku

Microsoft Certified Azure Data Engineer Associate
- DP 200: Implementing an Azure Data Solution
- DP 201: Designing an Azure Data Solution

Meer person

ID : 2042

Associate Software Engineer

Education level: Bachelor's degree

Work experience level: Intermediate- (2-4 year experience)

ID : 2041

System Engineer IT

Education level: Bachelor's degree

Work experience level: Experienced- (4-7 year experience)

ID : 2040

Associate Engineer

Education level: Bachelor's degree

Work experience level: Associate- (1-2 year experience)

ID : 2039

Intern

Education level: Bachelor's degree

Work experience level: Beginner- (internship- 1 year experience)

Senior Data Engineer

Meer person

Mis geen enkele belangrijke kennisgeving houd jezelf update