#GPT3 attracted lots of attention. Let’s try new format of discussing the matter in the comments, provided by peerboard.

For accessing the comments, just click the link below ⬇️⬇️⬇️, authorize with the telegram and follow the discussion.

(Rich Sutton, author of http://www.incompleteideas.net/IncIdeas/BitterLesson.html is on the right)

Applying GPT-3 to generate neural network code

Matt Shumer used GPT-3 to generate code for a machine learning model, just by describing the dataset and required output.

#GPT3 #inception #codegeneration #NLU #NLP

​​Astrologers proclaimed the week of #codegeneration. Number of articles about the subject doubled.

Deep learning to translate between programming languages

#FacebookAI released TransCoder, an entirely self-supervised neural transcompiler system that is claimed to make code migration easier and more efficient.

ArXiV: https://arxiv.org/pdf/2006.03511.pdf
Github: https://github.com/facebookresearch/TransCoder/

#NLU #codegeneration #NLP

pytorch v1.6

[0] native mixed-precision support from nvidia (~2x perf improvement)
[1] distributed perf improvements
[2] new profiling tool for memory consumption
[3] microsoft commits to developing
[4] maintaining windows pytorch
…

github: https://github.com/pytorch/pytorch/releases/tag/v1.6.0

​​Funnel Activation for Visual Recognition

Authors offer a new activation function for image recognition tasks, called Funnel activation (FReLU), that extends ReLU and PReLU to a 2D activation by adding a negligible overhead of spatial condition.

Extensive experiments on COCO, ImageNet and CityScape show significant improvement and robustness.


Paper: https://arxiv.org/abs/2007.11824
Code: https://github.com/megvii-model/FunnelAct

#deeplearning #activationfunction #computervision #pytorch

#Facebook released github repo with code for #TransCoder : https://github.com/facebookresearch/TransCoder/

Our friends from @loss_function_porn released their app and climbed AppStore top chart!

Let’s help them preserve that position by downloading an app and giving them 5⭐️.

​​Stanford updated tool Stanza with #NER for biomedical and clinical terms

Stanza extended with first domain-specific models for biomedical and clinical medical English. They range from approaching to significantly improving state of the art results on syntactic and NER tasks.

That means that now neural networks are capable of understanding difficult texts with lots of specific terms. That means better search, improved knowledge extraction and approach for performing META analysis, or even research with medical ArXiV publications.

Demo: http://stanza.run/bio
ArXiV: https://arxiv.org/abs/2007.14640

#NLProc #NLU #Stanford #biolearning #medicallearning

​​Hope that someday DL industry will evolve enough to develop tools for recognizing russian doctors’ handwriting.

english to regex

generating regex by just describing it and providing an example (apparently powered by gpt-3)


web page: https://losslesshq.com

#regext #gpt3

​​Last day to apply for free Skoltech's Summer School of Machine Learning

Benefits of School:
+ top speakers from leading Data Science centers
+ new knowledge and advanced trends in statistical methods of machine learning.
+ free participation

How to apply:
Today is the LAST DAY to apply to school at the website

Link: https://smiles.skoltech.ru/school

#openedu #course #free #ml

Important information about the International Summer Online School of Machine Learning (SMILES):

We are often asked, what is a poster and why should you upload it if participation is free?

Let's go through this: submitting a poster about your project or research is a long-standing tradition at summer schools. The content should be informative, yet concise enough for the reader to understand your idea in 2 minutes or less.

What's the point?

Reason №1. The event will bring together top speakers, scientists, and entrepreneurs. So this is a good opportunity to get an expert opinion on your work, find partners for research, and potential investors and employers.

Reason №2. If you submit a poster, you will get access to the full range of events within SMILES: fireside chats, speed dating, social events, some lectures, etc.

Here are some examples of posters:
—​ https://bit.ly/2OSjfvs
—​ https://bit.ly/30H0XT7

If you still have questions, feel free to ask us in the comments. But If you don't, apply to SMILES and upload your poster right now:​ https://smiles.skoltech.ru/school

🚨Update: lectures will be available without registration 😍🤩🚨
🚨Update 2: poster examples🚨
— https://bit.ly/2OSjfvs
— https://bit.ly/30H0XT7

Image "Cloaking" for Personal Privacy

New research project from the University of Chicago CS group claims to provide a new face recognition protection mechanism.

Project link: https://sandlab.cs.uchicago.edu/fawkes/
Github: https://github.com/Shawn-Shan/fawkes

#Privacy #DL #CV #facerecognition

​​train your tf models on google cloud by tensorflow cloud

tf cloud is a python package that provides api for a transition from debugging and training keras & tf code in the local environment to distributed training in google cloud. it simplifies the process of training models on the cloud into a single, simple function call, requiring minimal setup and almost zero changes to model.
tf cloud handles cloud-specific tasks such as creating vm instances and distribution strategies for models automatically.


blog post: https://blog.tensorflow.org/2020/08/train-your-tensorflow-model-on-google.html?linkId=95907203
github: https://github.com/tensorflow/cloud

#tensorflow #cloud

generative elements of interior decoration by richard lord

​​Salesforce opensourced AI-framework for economic RL

AI Economist is capable of learning dynamic tax policies that optimize equality along with productivity in simulated economies, outperforming alternative tax systems.

Github: https://github.com/salesforce/ai-economist
Blog post with results: https://blog.einstein.ai/the-ai-economist/
Blog post with release: https://blog.einstein.ai/the-ai-economist-moonshot/

#Salesforce #gym #RL #economics #AIEconomics #animalcrossing #AIEconomist