Abhishek

Use change data capture with MSK Connect to sync data between Aurora MySQL and DynamoDBThis is the second part of the blog series which provides a step-by-step walkthrough of data pipelines with Kafka and Kafka Connect. I will be using AWS for demonstration purposes, but the concepts apply to any equivalent options (e.g. running these locally in Docker).Photo by Darya Jum on UnsplashThis part will show Change Data Capture in action that lets you track row-level changes in database tables in response to create, update and…

Integrate DynamoDB with MSK and MSK ConnectThere are many ways to stitch data pipelines — open source components, managed services, ETL tools, etc. In the Kafka world, Kafka Connect is the tool of choice for “streaming data between Apache Kafka and other systems”. It has an extensive set of pre-built source and sink connectors as well as a common framework for Kafka connectors which standardises integration of other data systems with Kafka and making it simpler to develop your own connectors, should there be a need to do…

How you can learn and avoid these mistakes in the futurePhoto by LinkedIn Sales Solutions on UnsplashData Science is one of the fastest-growing domains in the technology industry. If you are looking for an entry-level Data Scientist (DS) or Machine Learning Engineer (MLE) job straight out of college, it is important to know a few common mistakes in the interview. A simple naïve mistake can reduce your chances of being shortlisted.If you are consistently getting rejected for DS or MLE roles, you need to analyze and…