[D] Machine Learning - WAYR (What Are You Reading) - Week 93

This is a place to share machine learning research papers, journals, and articles that you're reading this week. If it relates to what you're researching, by all means elaborate and give us your insight, otherwise it could just be an interesting paper you've read.

Please try to provide some insight from your understanding and please don't post things which are present in wiki.

Preferably you should link the arxiv page (not the PDF, you can easily access the PDF from the summary page but not the other way around) or any other pertinent links.

Previous weeks :

|1-10|11-20|21-30|31-40|41-50|51-60|61-70|71-80|81-90|91-100|
|----|-----|-----|-----|-----|-----|-----|-----|-----|------|
|[Week 1](https://www.reddit.com/4qyjiq)|[Week 11](https://www.reddit.com/57xw56)|[Week 21](https://www.reddit.com/60ildf)|[Week 31](https://www.reddit.com/6s0k1u)|[Week 41](https://www.reddit.com/7tn2ax)|[Week 51](https://reddit.com/9s9el5)|[Week 61](https://reddit.com/bfsx4z)|[Week 71](https://reddit.com/d7vno3)|[Week 81](https://reddit.com/f1f0iq)|[Week 91](https://reddit.com/hlt38o)||||||||
|[Week 2](https://www.reddit.com/4s2xqm)|[Week 12](https://www.reddit.com/5acb1t)|[Week 22](https://www.reddit.com/64jwde)|[Week 32](https://www.reddit.com/72ab5y)|[Week 42](https://www.reddit.com/7wvjfk)|[Week 52](https://reddit.com/a4opot)|[Week 62](https://reddit.com/bl29ov)|[Week 72](https://reddit.com/de8h48)|[Week 82](https://reddit.com/f8fs6z)|[Week 92](https://reddit.com/hu6zq9)||
|[Week 3](https://www.reddit.com/4t7mqm)|[Week 13](https://www.reddit.com/5cwfb6)|[Week 23](https://www.reddit.com/674331)|[Week 33](https://www.reddit.com/75405d)|[Week 43](https://www.reddit.com/807ex4)|[Week 53](https://reddit.com/a8yaro)|[Week 63](https://reddit.com/bqlb3v)|[Week 73](https://reddit.com/dkox1s)|[Week 83](https://reddit.com/ffi41b)||
|[Week 4](https://www.reddit.com/4ub2kw)|[Week 14](https://www.reddit.com/5fc5mh)|[Week 24](https://www.reddit.com/68hhhb)|[Week 34](https://www.reddit.com/782js9)|[Week 44](https://reddit.com/8aluhs)|[Week 54](https://reddit.com/ad9ssz)|[Week 64](https://reddit.com/bw1jm7)|[Week 74](https://reddit.com/dr6nca)|[Week 84](https://reddit.com/fn62r1)||
|[Week 5](https://www.reddit.com/4xomf7)|[Week 15](https://www.reddit.com/5hy4ur)|[Week 25](https://www.reddit.com/69teiz)|[Week 35](https://www.reddit.com/7b0av0)|[Week 45](https://reddit.com/8tnnez)|[Week 55](https://reddit.com/ai29gi)|[Week 65](https://reddit.com/c7itkk)|[Week 75](https://reddit.com/dxshkg)|[Week 85](https://reddit.com/fvk7j6)||
|[Week 6](https://www.reddit.com/4zcyvk)|[Week 16](https://www.reddit.com/5kd6vd)|[Week 26](https://www.reddit.com/6d7nb1)|[Week 36](https://www.reddit.com/7e3fx6)|[Week 46](https://reddit.com/8x48oj)|[Week 56](https://reddit.com/ap8ctk)|[Week 66](https://reddit.com/cd7gko)|[Week 76](https://reddit.com/e4nmyk)|[Week 86](https://reddit.com/g4eavg)||
|[Week 7](https://www.reddit.com/52t6mo)|[Week 17](https://www.reddit.com/5ob7dx)|[Week 27](https://www.reddit.com/6gngwc)|[Week 37](https://www.reddit.com/7hcc2c)|[Week 47](https://reddit.com/910jmh)|[Week 57](https://reddit.com/auci7c)|[Week 67](https://reddit.com/cj0kyc)|[Week 77](https://reddit.com/eb4lxk)|[Week 87](https://reddit.com/gcx3uf)||
|[Week 8](https://www.reddit.com/53heol)|[Week 18](https://www.reddit.com/5r14yd)|[Week 28](https://www.reddit.com/6jgdva)|[Week 38](https://www.reddit.com/7kgcqr)|[Week 48](https://reddit.com/94up0g)|[Week 58](https://reddit.com/azjoht)|[Week 68](https://reddit.com/cp1jex)|[Week 78](https://reddit.com/ehbfst)|[Week 88](https://reddit.com/glm6sv)||
|[Week 9](https://www.reddit.com/54kvsu)|[Week 19](https://www.reddit.com/5tt9cz)|[Week 29](https://www.reddit.com/6m9l1v)|[Week 39](https://www.reddit.com/7nayri)|[Week 49](https://reddit.com/98n2rt)|[Week 59](https://reddit.com/b50r5y)|[Week 69](https://reddit.com/cvde5a)|[Week 79](https://reddit.com/entcxy)|[Week 89](https://reddit.com/gu5t0d)||
|[Week 10](https://www.reddit.com/56s2oa)|[Week 20](https://www.reddit.com/5wh2wb)|[Week

30](https://www.reddit.com/6p3ha7)|[Week 40](https://www.reddit.com/7qel9p)|[Week 50](https://reddit.com/9cf158)|[Week 60](https://reddit.com/bakew0)|[Week 70](https://reddit.com/d1g1k9)|[Week 80](https://reddit.com/euctyw)|[Week 90](https://reddit.com/hddf7j)||

Most upvoted papers two weeks ago:

Besides that, there are no rules, have fun.

/r/MachineLearning
https://redd.it/iaz892

Google Colab Torrent Downloader

[Github Link](https://github.com/nishan7/Google-Colab-Torrent-Downloader)

I created a python notebook to download torrent from google colab directly into Google drive.

/r/Python
https://redd.it/ibhvl8

A New Interesting Framework

Are you interested in ethical hacking ?? If yes . would not it be great if the framework is in \*\*python\*\* . with over 18 payload in python . and flexable enough to help you **generate your own payload in python** . and **no need for using hard syntax for passing arguments to the generator** . because it works with menus . works on different platforms .

[ZKit-Framework](https://github.com/000Zer000/ZKit-Framework) is the framework Im talking about . because of some problems i cant include a picture of it working . **but please use it legally and Have Fun** !

/r/Python
https://redd.it/ibvyov

[D] How do ML researchers make progress when iteration cost is prohibitively high? (GPT3, Image-GPT, Autopilot, RL, etc.)

Today Andrej Karpathy released code for a minimal gpt implementation ([here](https://github.com/karpathy/minGPT)), but what I found most interesting was his notes on the implementations. In particular at the end of the README he noted from the GPT-3 paper:
> GPT-3: 96 layers, 96 heads, with d_model of 12,288 (175B parameters).

> GPT-1-like: 12 layers, 12 heads, d_model 768 (125M)

> We use the same model and architecture as GPT-2, including the modified initialization, pre-normalization, and reversible tokenization described therein

> we use alternating dense and locally banded sparse attention patterns in the layers of the transformer, similar to the Sparse Transformer

> we always have the feedforward layer four times the size of the bottleneck layer, dff = 4 ∗ dmodel

> all models use a context window of nctx = 2048 tokens.

> Adam with β1 = 0.9, β2 = 0.95, and eps = 10−8

> All models use weight decay of 0.1 to provide a small amount of regularization. (NOTE: GPT-1 used 0.01 I believe, see above)

> clip the global norm of the gradient at 1.0

> Linear LR warmup over the first 375 million tokens. Then use cosine decay for learning rate down to 10% of its value, over 260 billion tokens.

> gradually increase the batch size

/r/MachineLearning
https://redd.it/ibrlvt

django-scan-fields update: Now generate frontend forms based on your django models

Hi guys!

A few months ago I created [Django scan models](https://github.com/jessielaf/django-scan-models). I also posted a [post](https://www.reddit.com/r/django/comments/fob7om/djangoscanmodels_parse_django_models_to_frontend/) about this to this subreddit. Now I have come with an update! Called [vue-scan-field](https://github.com/jessielaf/vue-scan-field).

This package can create input fields in Vue based on the code generated by Django scan models! This means that your frontend validation and forms are up to date all the time!

It currently only works with Vuetify as UI framework and vee-validate as validator. But if there are requests I can look to integrate other frameworks.

/r/django
https://redd.it/ibwwp1

Autocompleter

Hello!

Im new to juputerlabs.

I'm trying to install a autocomplete like "Kite" in jupyterlabs as an extension.
But I'm not successful.

Anyone, that have any tips?

/r/JupyterNotebooks
https://redd.it/ibyifi

What's everyone working on this week?

Tell /r/python what you're working on this week! You can be bragging, grousing, sharing your passion, or explaining your pain. Talk about your current project or your pet project; whatever you want to share.

/r/Python
https://redd.it/ic1ow3

A Bot That Tweets When You Swear

Hey! Yesterday I [posted my video](https://www.reddit.com/r/Python/comments/ibcma1/i_play_super_mario_with_my_face/) about Python program that lets you play Super Mario with your face. Responses I got from r/Python were amazing. Now I'm going to share my 2nd project that I've uploaded to my YouTube channel as well. Using OCR, it can detect if you've died or not.

[A Bot That Tweets When You Swear](https://www.youtube.com/watch?v=k4rdKAoi_gk&feature=youtu.be)

The idea comes when YouTubers lately can't speak out anything that they wish, like swearwords, for example. I made this bot to save the day & make sure they won't be cancelled (at least).

Let me know what you think & please leave some thoughts. Thanks!

/r/Python
https://redd.it/ic0rvu

#Novice Trying to install umap library but no luck. I'm not sure I understand the whole conda install or pip for that matter, I was following the instructions on the anaconda documentation here anaconda.org/conda-forge/umap-learn

End goal is to use in Jupyter notebook, I have a different environment which is where I was hoping to install but at this point any environment even base install fails. After running the command on Anaconda prompt, install umap in a Jupyter cell gives me error 'No module named numpy.core._multiarray_umath'. Someone tell me what is it that I should be doing in what order, tia

Edit: Used this and got to work in terminal conda install -n myenv umap-learn

/r/IPython
https://redd.it/ic5vlg

[D] Why ML conference reviews suck - A video analysis of the incentive structures behind publishing & reviewing.

[https://youtu.be/VgqHitvEbR0](https://youtu.be/VgqHitvEbR0)

Machine Learning research is in dire straits as more people flood into the field and competent reviewers are scarce and overloaded. This video takes a look at the incentive structures behind the current system and describes how they create a negative feedback loop. In the end, I'll go through some proposed solutions and add my own thoughts.

OUTLINE:

0:00 - Intro

1:05 - The ML Boom

3:10 - Author Incentives

7:00 - Conference Incentives

8:00 - Reviewer Incentives

13:10 - Proposed Solutions

17:20 - A Better Solution

23:50 - The Road Ahead

/r/MachineLearning
https://redd.it/ibz7y2

[P] Simplify.so: a free GPT-3 powered site for simplifying complicated subjects

[https://www.simplify.so/](https://www.simplify.so/)

Currently one must give an email address to create an account to use this site.

/r/MachineLearning
https://redd.it/ic8o0k

How to handle mass email in Django?

Hello, I recently created a website, it allows users to write a letter to their future selves. They provide their email, name and write the letter. We sent the email on the date they selected.

It is going pretty well and it is becoming viral on tiktok and instagram, on the first 4 days we reached +5000 letters written.

Now i'm facing a problem. I'm using django.core.mail with gmail to send the emails. I havent yet sent any email because my website only allows to send emails with a minimum date of one month in the future (i have time to figure this out). The problem is that in one single day, 1300 people wrote letters to be sent in a year, so in a year i will have to send more than 1300 letters in a single day!

I'm pretty sure that django.core.mail + gmail wont be able to handle this massive email list. So here is my question: Is there a way I can send a massive amount of emails in a single day and make sure that they will be sent?

I heard that gmail only allows you to send 400 mails in 24hs. Is that true?

I am in low cost

/r/django
https://redd.it/ic31qh

Showing PDF Preview in Django

I'm currently developing an app in which users upload a pdf document which is then displayed using an iframe within a DetailView. However, I would like to only show a preview of the pdf document within the iframe (the first couple of pages). If at all relevant, I am using s3 to store the pdf files.

​

Is anybody aware of any method to either specify that only the first page, or a selection of pages, of the pdf is shown in the template?

​

I have also considered saving a 'filepreview' fileField attribute to the model, in addition to the whole document attribute, which (in theory) would be an edited version of the pdf. If the first option isn't possible, does anybody know how I might approach editing the pdf submitted by my users to remove all but the first page in order that I can deliver the 'filepreview' document to my template?

Perhaps there is another method I am missing? If so, please do let me know!

​

Thanks in advance.

/r/django
https://redd.it/ibxgkp

Wednesday megathread: Beginner questions

New to Python and have questions? Use this thread to ask anything about Python, there are no bad questions!

/r/Python
https://redd.it/iccu4o

I am bad at query jobs, where should i learn it from a-z?

Every time, i have to query some list or something to display it to the template, i have a struggle with it, is there any tutorial other than documentation to learn it?

/r/django
https://redd.it/ic0yjc

AI Learns to play the Chrome dinosaur game!

I made this project using pygame and NEAT. It uses neural networks to learn how to play a recreation of the google chrome dinosaur game.

[Youtube Video](https://www.youtube.com/watch?v=TmwZNfGn--k)

[Github](https://github.com/000Nobody/Chrome-Dinosaur-AI)

/r/Python
https://redd.it/ic2t6v

Nested Form Validation using inbuilt WTForm Validator

I want to validate form and nested form using inbuilt WTForm validator.

/r/flask
https://redd.it/icjkyp

avoid the html output when running nbconvert

I'm using \`\`\`jupyter nbconvert\`\`\` in a bash script to run several notebooks. The script is then submitted to a cluster via slurm.

Is there a flag for nbconvert to avoid the html output when the notebook has been run?

Something like \`\`\`--no-output\`\`\` or \`\`\`no-html\`\`\`?

I know that they are useful to check the proper execution of the notebook and, of course, one can always delete them :)

/r/IPython
https://redd.it/ick5ow

When you learn to code your first GUI.

/r/Python
https://redd.it/ickj17