Stay Home🏡, Stay Safe ❤️ #Airflow #DAG #CoronaVirus

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform. - san089/goodreads_etl_pipeline

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems - binhnguyennus/awesome-scalability

This post demonstrates how to install Dr. Elephant and Sparklens on an Amazon EMR cluster and run workloads to demonstrate these tools’ capabilities. Amazon EMR is a managed Hadoop service offered by AWS to easily and cost-effectively run Hadoop and other…

Literate programming is now a reality through nbdev and the new visual debugger for Jupyter.

The analytics value lifecycle is a good way to think about how an analytics team should operate.

What we learned from the spy in your pocket.

Find out how to apply Apache Spark™’s advanced analytics techniques and deep learning models at scale. Download your copy of the eBook to learn: The fundamentals of advanced analytics — with a crash course in ML MLlib: Get a deep dive on the primary ML package…

Ceph is a distributed object, block, and file storage platform - ceph/ceph

TL;DR: Disk is Frickin’ Slow. Network is Worse.

Customers use Apache Hive with Amazon EMR to provide SQL-based access to petabytes of data stored on Amazon S3. Amazon EMR 6.0.0 adds support for Hive LLAP, providing an average performance speedup of 2x over EMR 5.29, with up to 10x improvement on individual…

The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data :bar_chart: - metabase/metabase

It will use Bluetooth connections, not location tracking.

Data analytics has become increasingly important over the past several years as organizations increasingly find that data is the key to…

Terraform best practices and how to adopt them

Every developer and team can now get private repositories with unlimited collaborators at no cost with GitHub Free, and we reduced prices for some of our paid plans.

At Redpoint, we’ve invested in more than 15 data companies and deployed $250M+ in capital over the last few years. We’re long-time…

Apache Arrow, a specification for an in-memory columnar data format, and associated projects: Parquet for compressed on-disk data, Flight for highly efficient RPC, and other projects for in-memory query processing will likely shape the future of OLAP a...