Aveek Das

Data Engineer, Cloud Data Architect, Thinker, Traveler, Amateur Photographer. Enjoys short walks for hot chocolates. Blogs @ https://datacloudmag.com

Aveek is an experienced Data Engineer and Business Intelligence professional with around five years of expertise in cloud platforms like AWS and Azure. He helps clients build data pipelines using data integration tools, uncover insights from their own data, and recommend actionable items. He has successfully done projects in various sectors, such as retail, insurance, leisure, and RSA.

Aveek likes to work on projects which revolve around cloud data technologies such as AWS and Azure. He is well versed with AWS services like Glue, Redshift, Lambda, SQS, Kinesis, RDS, QuickSight, and Azure services like Data Factory, Synapse Analytics, SQL Database, etc. He takes on projects that cover the entire life cycle of a data engineering project: ETL architecture, design, and development of the Data Warehouse, development of an OLAP/analytics data model (Redshift / Analysis Services), and finally designing the presentation layer in QuickSight, Power BI, Qlik Sense or Tableau. For designing data warehouses, Aveek is well versed in the Kimball methodology, star, and snowflake schemas, however, he also has a background in Data Vault and Data Lakes. He has worked with different versions of databases such as MySQL, PostgreSQL, SQL Server.

In addition to this, Aveek is also loves working on personal and open-source projects. He is involved in developing a chatbot that uses Natural Language from customers to answer questions about their data. It’s based on Microsoft Bot Framework coupled with Cognitive Services as a utility to interact with customers using various channels, such as Slack, Skype, etc. Recently, he is also developing and maintaining an open-source project, which is under incubation and dwells around version control and migration for Amazon QuickSight.

Over the years, Aveek has developed expertise using the following tools:

  • AWS Glue, Data Pipeline, Azure Data Factory, Integration Services (SSIS).
  • Streaming Data Processing using AWS Kinesis, Apache Kafka.
  • AWS Redshift, Azure Synapse Analytics, Analysis Services (SSAS Multidimensional and Tabular); also, well versed in writing MDX and DAX queries.
  • Data Visualization (Amazon QuickSight, Power BI, Qlik Sense, QlikView, Tableau)

In his leisure, he likes to keep his skills sharp by completing certification programs, writing articles on his blog, and also for SQLShack and SQLServerCentral. He is also an amateur photographer and hops around to do photography, mostly street and still life. While at home, he likes to cook and watch television series.


Modular ETL Architecture Design in SSIS

Overview of ETL Architecture In a data warehouse, one of the main parts of the entire system is the ETL process. ETL is the system...

A User-Defined Function returns more rows

Problem Recently, while working with one of my clients, I came across a script in which I had to introduce a scalar User-Defined Function in...