At the moment Kubernetes is one of the most exciting technologies in the world of DevOps. Recently a lot of hype has formed around it for one simple reason, and this reason is the mighty containers.

https://luminousmen.com/post/kubernetes-101

It[AI] wears a cloak of black velvet; and a cowl, covering its face. It sits, on a throne made of dry bones of the dead, at the center of a large hall...
— GPT-3

A small fantastic story in which part of the text and the dialogue at the end are written by neuron GPT-3. At the edges there is communication between the author and the network, for me it seems the most interesting part.

https://jamesyu.org/singular/

#ds

Researchers from Google Research offered a whole family of scalable and efficient classifiers called EfficientDet.

Tests have shown that the new technology is able to show accuracy commensurate with its predecessors, while being 9 times smaller and using less computing power.

https://ai.googleblog.com/2020/04/efficientdet-towards-scalable-and.html (https://ai.googleblog.com/2020/04/efficientdet-towards-scalable-and.html)

#ml #ds

Facebook developed an online solution called TransCoder, whose main task is to translate code from one language to another using deep learning. Now the solution can successfully translate functions between C++, Python 3 and Java.

Now it's easy to move to Python from Java ;)


https://ai.facebook.com/blog/deep-learning-to-translate-between-programming-languages/

#python #ml

The researchers fed raw data from the Kepler telescope (retired) to a ML model that had previously been trained to recognize exoplanets - and received potentially 50 new exoplanets that were previously unknown.

https://www.cnn.com/2020/08/26/tech/ai-new-planets-confirmed-intl-hnk-scli-scn/index.html?tg.

#ml

Why TPU so fast?

https://youtu.be/JC84GCU7zqA

#ml

Data ethics course from fast.ai

https://ethics.fast.ai/

#ml

Interesting story from the ex-googler about GCP lack of support. Many f words, which is understandable for me - I don’t like the platform myself.

https://medium.com/@steve.yegge/dear-google-cloud-your-deprecation-policy-is-killing-you-ee7525dc05dc

NVIDIA introduced its PyTorch-based framework, which is designed to help integrate deep learning solutions into healthcare imaging projects.

https://github.com/Project-MONAI/MONAI

#ml

A large review on how TickTock uses machine learning to increase user engagement and pierce the "filter bubble". Nothing really fancy just interesting to read the problems they trying to solve.

https://www.axios.com/inside-tiktoks-killer-algorithm-52454fb2-6bab-405d-a407-31954ac1cf16.html

Announcing GPU accelerated Spark 3.0

https://youtu.be/tpeGZ7nm0J0

#spark #big_data #ml

AWS has implemented the linux-based operating system Bottlerocket. It is an open-source project, developed by AWS as a basic host to run containers. The general idea is that nowadays, in most cases, general-purpose operating systems are used to start containers, which does not contribute to the security and capability of an atomic update.

https://aws.amazon.com/blogs/opensource/announcing-the-general-availability-of-bottlerocket-an-open-source-linux-distribution-purpose-built-to-run-containers/

I've been recommending Pi-hole not long ago but RCE exploit was discovered in the Pi-hole software. This particular problem requires authenticated access to the Pi-hole administrative web interface, so it’s not likely to cause too many problems on its own but anyway.

https://frichetten.com/blog/cve-2020-11108-pihole-rce/

#privacy

Famous in-memory data format

Apache Arrow is a sacred grail of analytics that was invented not so long ago. It is a special format for column data storage in memory. It allows you to copy objects from one process to another very quickly - from pandas to PyTorch, from pandas to TensorFlow, from Cuda to PyTorch, from one node to another node, etc.. This makes it the horse of a large number of frameworks for both analytics and big data.

I actually don't know any other in-memory format with complex data, dynamic schemas, performance, and platform support.

Apache Arrow itself is not a storage or execution engine. It is designed to serve as a foundation for the following types of systems:

- SQL execution engines (Drill, Impala etc)
- Data analysis systems (Pandas, Spark etc)
- Streaming and queueing systems (Kafka, Storm etc)
- Storage systems (Parquet, Kudu, Cassandra etc)
- Machine Learning libraries(TensorFlow, Petastorm, Rapids etc)

Please do not think that this is part of Parquet format or part of PySpark. This is a separate self-contained format which I think is a bit undervalued and should be taught with all other big data formats.

https://arrow.apache.org/overview/

#big_data

Where do I start to learn AWS?

So, if you go to the AWS Documentation you will see an endless list of services, but it's just the global table of contents of global tables of contents! That's right — Amazon is huge right now. At the time of writing these lines are two and a half hundred services under the hood. It is not realistic to learn them all, and there is no reason to do it at all.

John Markoff says “The Internet is entering its Lego era.” AWS services is similar to Lego — you finding the right pieces and combine them together. In order to highlight the most essential pieces it is reasonable to say that they were historically the first. They are:

- S3 — storage
- EC2 — virtual machines + EBS drives
- RDS — databases
- Route53 — DNS
- VPC — network
- ELB — load balancers
- CloudFront — CDN
- SQS/SNS — messages
- IAM — main access rights to everything
- CloudWatch — logs/metrics

Then there are modern serverless pieces (Lambda, DynamoDB, API Gateway, CloudFront, IAM, SNS, SQS, Step Functions, EventBridge).

#aws

Rapids

Nvidia has been developing an open source platform Rapids, whose task is to accelerate the work of data processing and machine learning algorithms on the GPU. Developers on Rapids don't have to use different libraries: they just write code in Python, and Rapids automatically optimizes it to run on the GPU. All data is stored in the Apache Arrow format in-memory.

I already wrote about GPU vs CPU. But the problem is that the amount of memory using the CPU we have now is limited to terabytes, and the GPU has a maximum of 50 GB of memory. Here Dask comes to the rescue - integration with Dask gives Rapids GPU clusters with multi GPU support.

The Rapids repository has the cuDF library for data preparation and neural network training, and the cuML library allows to develop machine learning algorithms without going into the details of CUDA programming.

Sounds cool, doesn't it? But, there is always but:
- it's still not production ready
- porting any complex udf is very hard (at least you should know cuda, which I don't)
- no cpu libraries version for inference
- no automatic memory management
- it's nvidia only

https://github.com/rapidsai

#ml