basic comparison of flume vs. Kafka Bottom line: combine both.

amqp-kafka-bridge - AMQP - Apache Kafka bridge

Get your data via REST into Apache Kafka. Contribute to markush81/kafka-rest-proxy development by creating an account on GitHub.

This talk was recorded at Scala Days Chicago, 2017. Follow along on Twitter @scaladays and on the website for more information scaladays.org/. Abstract: Compared to a traditional analysis-centric data hub, today's data platforms need to fulfill many different…

Apache Kafka provides a solid foundation on which to build event-sourced systems.

Lenses for your DataOps enterprise platform, to operate with confidence on Apache Kafka with intuitive ui and fine-grained controls

The enterprise DataOps overlay for Apache Kafka & Kubernetes for streaming data and pipelines - Lenses.io

In this session by Konrad Malawski, author, speaker and Senior Akka Engineer at Lightbend, you will learn how to build these streaming ETL pipelines with Akka Streams, Alpakka and Apache Kafka, and why they matter to enterprises that are increasingly turning…

This talk was recorded at Scala Days Chicago, 2017. Follow along on Twitter @scaladays and on the website for more information http://scaladays.org/.

Abstract:
Compared to a traditional analysis-centric data hub, today's data platforms need to fulfill many…

Your app is a hit. Everyone's using your service. You've instrumented your website to collect real time usage data and you've set up a data processing pipeline to work with large amounts of data in real time, but how do you bridge the gap between web page…

This talk was recorded at Scala Days New York, 2016. Follow along on Twitter @scaladays and on the website for more information http://scaladays.org/.

Abstract:
Transitioning from a monolithic application to a set of microservices can help increase performance…

Confluent Operator EA: https://cnfl.io/k8s | In this video Viktor Gamov, developer advocate at Confluent, explains basics of Helm - a package manager for Kubernetes - and how to use Helm Charts to deploy Confluent Open Source Platform.

Resources:
Github…

People who are familiar with SMACK stack(Spark, Mesos, Akka, Cassandra, and Kafka) often find themselves working in the spectrum of big…

Get the slides: https://www.datacouncil.ai/talks/building-real-time-data-pipelines-made-easy-with-structured-streaming-in-apache-spark?utm_source=youtube&utm_medium=social&utm_campaign=%20-%20DEC-SF-18%20Slides%20Download

ABOUT THE TALK:

Structured Streaming…

New performance benchmark test shows Apache Pulsar delivering 2.5x better performance on OpenMessaging Benchmark

See how to integrate Spark structured streaming and Kafka by learning how to create a SparkSession, convert a stream based on mySchema and TimeStamp, and more.

ROCm, the Radeon Open Ecosystem, is an open-source software foundation for GPU computing on Linux. ROCm supports TensorFlow and PyTorch using MIOpen, a library of highly optimized GPU routines for deep learning. In this talk, we describe how Apache Spark…

In traditional AI systems, especially those involving recommendation engines or Retrieval-Augmented Generation (RAG), fine-tuning models is typically driven by explicit human feedback — thumbs up/down, star ratings, or click-through behavior. While this approach…