Data integration

Data chiefs in the Asia-Pacific region are pursuing the rollout of artificial intelligence in earnest, according to an international survey of 600 global data leaders from Informatica. India is racing ahead in the region, with 75% of those surveyed already having adopted generative AI. However, APAC-based respondents are facing hurdles around the management of data for AI. These include data fragmentation amid an exploding number of data sources, the quality of data available for AI, and embedding data…

DevOps and AI make an inseparable pair and impact businesses of all kinds. While DevOps enables speedy product development and easier maintenance of existing deployments, AI transforms the overall system functionality. The DevOps team can rely on artificial intelligence and machine learning for data integration, testing, evaluating, and releasing the system. What’s more, artificial intelligence and machine learning can improve the process driven by DevOps in an efficient, quick, and secure manner. Evaluating the…

Aviation and travel are notoriously vulnerable to social, economic, and political events, as well as the ever-changing expectations of consumers. The coronavirus was just a piece of the challenge. This post explores how Lufthansa leverages data streaming powered by Apache Kafka as cloud-native middleware for mission-critical data integration projects and as data fabric for AI/machine learning scenarios such as real-time predictions in fleet management. An interactive conversation with Lufthansa as an on-demand video is…

The $2.3 billion deal is expected to close in the second quarter of 2024. IBM continues to invest in AI and hybrid cloud with the Dec. 18 announcement of a definitive agreement with Software AG to acquire StreamSets and webMethods, two integration platform-as-a-service enterprise technology platforms. The deal is expected to close in Q2 2024 for $2.3 billion in cash. Jump to: What are the iPaaS platforms StreamSets and webMethods? StreamSets is a DataOps and data ingestion application. It is cloud…

The first impression most of us have about AI is likely from the sci-fi movies where robots overpower humans. Remember the films like “Terminator” or novels like “Robopocalypse”? Given the pace of development in the space of AI, we are witnessing the gap between fiction and reality closing day by day.  In fact, we have witnessed the initial phase of the AI evolution — from rules-based to the latest generative AI. According to a recent study by McKinsey, AI is expected to add $13 trillion to the global economy by 2030.…

The digital age has catapulted data into the spotlight, transforming it from mere binary sequences to valuable organizational assets. As businesses increasingly pivot towards data-driven strategies, the complexities surrounding data management have also amplified. The task at hand is not just storing or even collecting data but converting it into actionable intelligence. This blog aims to dissect two instrumental pillars in the quest for this intelligence: Data Integration and AI-driven insights. The narrative centers on…

On numerous occasions during Star Trek: The Next Generation’s run, Lt. Cmdr. Data, an android, communicates with the ship’s computer via spoken English. The writers want us, the audience, to hear their conversation, of course. But would it make sense for two AI-based systems to interact with each other via a conversation in English (or any other natural, aka ‘human’ language*)? Now that generative AI has taken off, this question no longer belongs in the realm of science fiction. We’ve struggled with machine-to-machine…

Data is a priceless resource for any company. But, the pace of innovation using data differs from organization to organization. Organizations with sprawling legacy systems slow down innovation, while cloud-native ones rapidly benefit from modern analytics and AI through more straightforward implementation. Companies with sizeable on-site data environments may plan to upgrade their data and use AI to overcome business obstacles. However, the transition from on-site to AI may seem intimidating to them. This post is intended…

In the previous article, we discussed the emergence of Date Lakehouses as the next-generation data management solution designed to address the limitations of traditional data warehouses and Data Lakes. Data Lakehouses combines the strengths of both approaches, providing a unified platform for storing, processing and analyzing diverse data types. This innovative approach offers flexibility, scalability, and advanced analytics capabilities that are essential for businesses to remain competitive in today's data-driven…

AWS Glue is a serverless data integration service that makes it easier to discover, prepare, move, and integrate data from multiple sources for analytics, machine learning (ML), and application development. This article will go into the best practices of application development and deployment on Cloud mandate using Infrastructure as code (IaC).  Out of the various technologies available in the market for writing IaC, AWS CDK leverages popular programming languages (Python, Typescript, Java, Go, etc.) and is widely adopted…