A Bluffer's Guide to Dimension Reduction
https://www.youtube.com/watch?v=9iol3Lk6kyU

/r/pystats
https://redd.it/an2leu

[R] TuckER: Tensor Factorization for Knowledge Graph Completion

​

https://i.redd.it/gicg4kh0zie21.png

​

**Paper:** [**https://arxiv.org/abs/1901.09590**](https://arxiv.org/abs/1901.09590)

**PyTorch Code:** [**https://github.com/ibalazevic/TuckER**](https://github.com/ibalazevic/TuckER)

​

**Key contributions:**

* proposing TuckER, a relatively simple **linear** model for **link prediction** in knowledge graphs that achieves **state-of-the-art results** across all standard datasets;
* proving that TuckER is **fully expressive** and deriving a bound on the entity and relation embedding dimensionality for full expressiveness which is several orders of magnitude lower than the bound of previous state-of-the-art models ComplEx and SimplE; and
* showing that TuckER **subsumes several previously proposed tensor factorization approaches** to link prediction, i.e. that RESCAL, DistMult, ComplEx and SimplE are all special cases of our model.

**Abstract:**

Knowledge graphs are structured representations of real world facts. However, they typically contain only a small subset of all possible facts. Link prediction is a task of inferring missing facts based on existing ones. We propose TuckER, a relatively simple but powerful linear model based on Tucker decomposition of the binary tensor representation of knowledge graph triples. TuckER outperforms all previous state-of-the-art models across standard link prediction datasets. We prove that TuckER is a fully expressive model, deriving the bound on its entity and relation embedding dimensionality for full expressiveness which is several orders of magnitude smaller than the bound of previous state-of-the-art models ComplEx and SimplE. We further show

/r/MachineLearning
https://redd.it/an09n8

How to keep the ML model of spaCy running for faster response

I am working on an NLP project in spaCy. I want to deploy my project on the internet, but I am facing a problem. The application checks individual sentences for their grammatical correctness and it is really quick once the ML model is loaded in the memory (with the command spacy.load('en')).
The problem is loading the ML model takes some time, around 30 seconds. How can I keep the model loaded so that it doesn't have to reload every time a new request comes in on the server?

/r/django
https://redd.it/an39k5

[Noob question] Should Django share a MySQL database with independent parts of the application?

There's two aspects to the database:

* The Django auto-created tables (auth_group, auth_user, django_session, etc.)

* The tables I will be creating separately. I have a crawler that's constantly inputting and modifying data in the db. This data will be used when rendering the HTML, as well as exposing it as a web service API.

I'm using Kubernetes and I have 3 containers in the pod:

* Django

* MySQL

* Crawler

I'm fairly inexperienced with all these technologies, and I'm just wondering if it's better to have all data under one database, or separate databases.

If I use just one database, should the source of truth (who creates the database) be Django?

/r/django
https://redd.it/an5bkd

Conda 4.6 Release: Better pip interoperability and PowerShell support
https://www.anaconda.com/conda-4-6-release/

/r/Python
https://redd.it/an5yzp

Using Virtual Environments in Jupyter Notebook and Python
https://janakiev.com/til/jupyter-virtual-envs/

/r/IPython
https://redd.it/an43ds

How to Test a Django Application: the Thought Process Behind Testing
https://www.valentinog.com/blog/testing-django/

/r/django
https://redd.it/an1bvm

[P] Mushroom: Reinforcement Learning library

Hi everyone,

during my PhD I worked on a RL python library which has the purpose to simplify the developing of RL experiments and which is highly customizable to let user add and test their own algorithms. It uses Gym and Pytorch (one can also use Tensorflow or other libraries transparently) to exploit already developed powerful libraries and just to focus on RL aspects. Recently, we added several policy gradient and actor-critic algorithms, such as the recent DPG. I'd really appreciate if you give a look to Mushroom and consider it for doing your research, or simply to give me a feedback on it. Here are the GitHub link: [https://github.com/AIRLab-POLIMI/mushroom](https://github.com/AIRLab-POLIMI/mushroom) and the doc link: [https://mushroomrl.readthedocs.io/en/latest/](https://mushroomrl.readthedocs.io/en/latest/).

Cheers!

/r/MachineLearning
https://redd.it/an3cqz

Practical Machine Learning Tutorial Using Keras
https://kite.com/blog/python/python-machine-learning-keras

/r/Python
https://redd.it/an7m6n

During logout on the web the DRF token is also logging out the native app, how do I stop this?

I have an API that is consumed by web client and native clients, when the user on the web logs out the token is invalidated and they are then logged out on mobile which is a bad user experience. How do I solve this?

It is conceivable to just forget the token on the web during logout but then it never changes and there is credit card data stored in the DB so that is not ideal.

/r/django
https://redd.it/an9wja

How to organize my django website

Hello all! I am super super super new to Django and python in general. I have begun the process of reading the documentation and going through tutorials and have come here for guidance.

The site I want to build would be for speakers at conferences to be able to upload their files prior to the event. I can easily wrap my head around having an app with a model of the general fields associated with this and a simple file upload form.

The part that I can't really figure out is how I would be able to have multiple conferences able to upload at the same time. As well as how non programming people would be able to set up a new conference to begin uploading to using only the admin interface.

Is there a way to create a new db table via admin interface? Should all of the entries just live in the same table with an entry determining which conference the entry belongs to? Am I being too ambitious for my first non-guided Django project?



/r/django
https://redd.it/an9jfe

A Django extension that implements PostgreSQL tables for partitioning and management based on dates.
https://django-pg-timepart.readthedocs.io/en/latest/

/r/django
https://redd.it/an9ieq

Replacing a spreadsheet...

I've successfully used Jupyter before, as a beginner for a few machine learning lessons, but I'm wondering if it's possible to use/abuse Jupyter to behave more like a spreadsheet, just in terms of having cells depend on other cells and continually update.

I've always felt limited by Excel because I really want to document my thinking in the way that Jupyter allows, with markdown blocks etc. (Before getting into Jupyter I've also been using Calca for the mac.) I also feel limited by Excel's functions, while I'm very comfortable with software programming - there have been so many times I've thought, ugh, this would be so much easier if I could just call 'map' on this array of data...

So I've been hoping to find something like Jupyter, where I can actually write my own functions and document my thinking, but where I can also input new data and have it be persistently stored, and have other cells update to changed data.

I know this isn't exactly what Jupyter is usually used for, since it's more to explore data in a linear fashion rather than in a reactive-programming fashion. So I guess this is a dual question:

Is it possible to make Jupyter behave

/r/IPython
https://redd.it/anb73f

Here's a quick tutorial on using virtual environments in Jupyter notebook and Python
https://janakiev.com/til/jupyter-virtual-envs/

/r/JupyterNotebooks
https://redd.it/an01e7

Honestly, just sharing because I'm stoked I figured this out on my own, even though it's very simple.

/r/Python
https://redd.it/anbjyx

Comprehensive Python Cheatsheet
https://gto76.github.io/python-cheatsheet/

/r/Python
https://redd.it/andswi

What's everyone working on this week?

Tell /r/python what you're working on this week! You can be bragging, grousing, sharing your passion, or explaining your pain. Talk about your current project or your pet project; whatever you want to share.


/r/Python
https://redd.it/anefyq

Which frontend do you prefer with Django?

Hey I am building Django app and I am wondering if React would be good choice for frontend or not.If not, what do you prefer? It's a simple app and only admin will use it but not in Django Admin.

/r/django
https://redd.it/ancuh7

Free Python books

I recently started learning Python and I’ve come across several great resources, including a number of ebooks that can be read online or downloaded for free. Some are well known, others less. Here’s the list of those books:

* [Python 101](https://python101.pythonlibrary.org/)
* [A Python Book: Beginning Python, Advanced Python, and Python Exercises](http://www.davekuhlman.org/python_book_01.html)
* [Boxes: Your Second Python Book](http://ralsina.gitlab.io/boxes-book/)
* [The Hitchhiker’s Guide to Python!](https://docs.python-guide.org/)
* [Automate the Boring Stuff with Python](https://automatetheboringstuff.com/)
* [Problem Solving with Algorithms and Data Structures using Python](https://interactivepython.org/runestone/static/pythonds/index.html#problem-solving-with-algorithms-and-data-structures-using-python)
* [Python for Scientists and Engineers](https://www.pythonforengineers.com/python-for-scientists-and-engineers/)
* [Think Python: How to Think Like a Computer Scientist](https://greenteapress.com/wp/think-python-2e/)
* [Clean Architectures in Python](https://leanpub.com/clean-architectures-in-python)
* [Teaching and Learning with Jupyter](https://jupyter4edu.github.io/jupyter-edu-book/)

What are your favorite free Python books?

/r/Python
https://redd.it/anfdyh

Flask Email Validation - Stop Nonsense Emails

For example, I get some emails that are clearly nonsense like sfdjhkj@kjh.com...

is there no way to mitigate this or some kind of library/algorithm to verify the validity of an email?

Doesn't have to be 100% of the time just in general.

/r/flask
https://redd.it/aneutz