Dataflows

“The Mixtral-8x7B Large Language Model (LLM) is a pre-trained generative Sparse Mixture of Experts.” When I saw this come out it seemed pretty interesting and accessible, so I gave it a try. With the proper prompting, it seems good. I am not sure if it’s better than Google Gemma, Meta LLAMA2, or OLLAMA Mistral for my use cases. Today I will show you how to utilize the new Mixtral LLM with Apache NiFi. This will require only a few steps to run Mixtral against your text inputs. This model can be run by the lightweight…

Prefect is a global coordination plane for any data stack. It allows you to design, build, schedule, and monitor your dataflows, covering the full spectrum from observability to orchestration. Here is an example of a simple Prefect flow:With a single CLI command, you can build a scheduled deployment that can run on any infrastructure — a local process, a Docker container, a Kubernetes job, or a serverless task on ECS Fargate. In this post, we’ll focus on the latter. But before we can deploy flows, we need an agent that…