#even_chan #apache_spark #time_series #filodb #akka_cluster #team #monix #productionalize
https://www.youtube.com/watch?v=WaDLoSYa4iI
https://www.youtube.com/watch?v=WaDLoSYa4iI
YouTube
scale.bythebay.io: Evan Chan, Building a High-Performance Database with Scala, Akka, and Spark
#distributedsystems #scala #akka #spark #FiloDB #cassandra Scala and its large ecosystem of libraries are increasingly being used to build highly scalable an...
#data_pipeline #bigdata #monadError #fp #spark_Streaming #akka #fs2 #Trembita #cassandra
https://www.youtube.com/watch?v=PDBVCVv4mVc&t=984s
https://www.youtube.com/watch?v=PDBVCVv4mVc&t=984s
YouTube
Vitalii Honta - Project Trembita - Functional Data Pipelining. ScalaUA2018
Vitalii Honta - Project Trembita - Functional Data Pipelining (Lightning Talk) ScalaUA2018 Project Trembita is a library in active development. Modules and f...
#apache_kafka #plus #apache_spark #spark_structured_streaming
https://dzone.com/articles/basic-example-for-spark-structured-streaming-amp-k
https://dzone.com/articles/basic-example-for-spark-structured-streaming-amp-k
dzone.com
Basic Example for Spark Structured Streaming and Kafka Integration - DZone Big Data
See how to integrate Spark structured streaming and Kafka by learning how to create a SparkSession, convert a stream based on mySchema and TimeStamp, and more.
#apache_spark #kubernetes #spark_operator
https://www.zdnet.com/article/google-announces-kubernetes-operator-for-apache-spark/
https://www.zdnet.com/article/google-announces-kubernetes-operator-for-apache-spark/
ZDNet
Google announces Kubernetes Operator for Apache Spark
The beta release of "Spark Operator" allows native execution of Spark applications on Kubernetes clusters -- no Hadoop or Mesos required.
#apache_spark #from #apache_sparkML #ml #to #tensorflow #kuberflow #holden #team #google #demo #databricks #team #spark_operator #demo
https://www.youtube.com/watch?v=0P5WO8f8qJg
https://www.youtube.com/watch?v=0P5WO8f8qJg
YouTube
Migrating Apache Spark ML Jobs to Spark + Tensorflow on Kubeflow - Holden Karau (Independent)
This talk will take an two existing Spark ML pipeline (Frank The Unicorn, for predicting PR comments (Scala) - https://github.com/franktheunicorn/predict-pr-...
#scala #tensorflow #python #apache_spark #spark #gpu
https://portal.klewel.com/watch/webcast/scala-days-2019/talk/37/
https://portal.klewel.com/watch/webcast/scala-days-2019/talk/37/
Klewel
Flare & Lantern: Accelerators for Spark and Deep Learning
Frameworks like Spark and TensorFlow have commoditized cluster computing and training of neural networks. However, they leave precious performance on the table, especially when used together. Flare is a new back-end for Spark SQL that yields significant speedups…
#serverless #serverless_ETL #ETL #graalVM #apache_spark #spark #kubernetes
https://www.youtube.com/watch?v=kDzsv6brQjo
https://www.youtube.com/watch?v=kDzsv6brQjo
YouTube
Scale By The Bay 2019: Rose Toomey, Moonshot Spark: serverless with GraalVM
Can Apache Spark slip its earthly bounds and go serverless, clusterless? Popular cloud services are becoming more capable. AWS Lamba now runs three times lon...