pomegranate v0.9.0 released: probabilistic modeling for Python
Howdy all!
I just released a new version of pomegranate. The focus of this version is on missing value support for all models in both the model fitting, structure learning, and inference steps for all models (probability distributions, k-means, mixture models, hidden Markov models, Bayesian networks, naive Bayes/Bayes classifiers). The general manner that this is done is by only collecting sufficient statistics from observed values, and ignoring missing values. This can frequently achieve better results than using common, simple, imputation methods.
* I've added documentation to the [readthedocs page](https://pomegranate.readthedocs.io/en/latest/) under the "Missing Values" section
* I've added an [extensive tutorial](https://github.com/jmschrei/pomegranate/blob/master/tutorials/Tutorial_9_Missing_Values.ipynb) on how missing value support is handled here
* I recently [gave a talk at ODSC west](https://www.youtube.com/watch?v=oF8BKWe9_i8) about pomegranate and the features recently incorporated (sadly before missing values were added).
The modular nature of pomegranate means that one can now use missing value support in conjunction with any of the other features. For example, one can easily add multi-threading to speed up models, or do out-of-core learning with incomplete data sets, or have both missing data and missing labels to do semi-supervised learning with missing data as well!
You can install pomegranate either by cloning the [GitHub repo](https://github.com/jmschrei/pomegranate), or with `pip install pomegranate`. Wheels should be built for all platforms soon, but some issues have delayed that. I hope to have them up soon, so you don't even need to deal with Cython.
As always, I'd love any feedback or questions!
/r/Python
https://redd.it/7nw5t0
Howdy all!
I just released a new version of pomegranate. The focus of this version is on missing value support for all models in both the model fitting, structure learning, and inference steps for all models (probability distributions, k-means, mixture models, hidden Markov models, Bayesian networks, naive Bayes/Bayes classifiers). The general manner that this is done is by only collecting sufficient statistics from observed values, and ignoring missing values. This can frequently achieve better results than using common, simple, imputation methods.
* I've added documentation to the [readthedocs page](https://pomegranate.readthedocs.io/en/latest/) under the "Missing Values" section
* I've added an [extensive tutorial](https://github.com/jmschrei/pomegranate/blob/master/tutorials/Tutorial_9_Missing_Values.ipynb) on how missing value support is handled here
* I recently [gave a talk at ODSC west](https://www.youtube.com/watch?v=oF8BKWe9_i8) about pomegranate and the features recently incorporated (sadly before missing values were added).
The modular nature of pomegranate means that one can now use missing value support in conjunction with any of the other features. For example, one can easily add multi-threading to speed up models, or do out-of-core learning with incomplete data sets, or have both missing data and missing labels to do semi-supervised learning with missing data as well!
You can install pomegranate either by cloning the [GitHub repo](https://github.com/jmschrei/pomegranate), or with `pip install pomegranate`. Wheels should be built for all platforms soon, but some issues have delayed that. I hope to have them up soon, so you don't even need to deal with Cython.
As always, I'd love any feedback or questions!
/r/Python
https://redd.it/7nw5t0
GitHub
jmschrei/pomegranate
pomegranate - Fast, flexible and easy to use probabilistic modelling in Python.
Simple way to ship Python/Flask web app using Docker
https://github.com/chhantyal/flask-docker
/r/Python
https://redd.it/7nvy3l
https://github.com/chhantyal/flask-docker
/r/Python
https://redd.it/7nvy3l
GitHub
GitHub - chhantyal/flask-docker: Fastest way to ship Python web apps, anywhere. Be shipping 🚀 (using Docker, Flask, Gunicorn, Whitenoise)
Fastest way to ship Python web apps, anywhere. Be shipping 🚀 (using Docker, Flask, Gunicorn, Whitenoise) - GitHub - chhantyal/flask-docker: Fastest way to ship Python web apps, anywhere. Be shippin...
dplyr-style Data Manipulation with Pipes in Python
http://www.allenkunle.me/dplyr-style-data-manipulation-in-python
/r/Python
https://redd.it/7o1edg
http://www.allenkunle.me/dplyr-style-data-manipulation-in-python
/r/Python
https://redd.it/7o1edg
reddit
dplyr-style Data Manipulation with Pipes in Python • r/Python
4 points and 1 comments so far on reddit
File format determination library for Python
https://github.com/floyernick/fleep
/r/Python
https://redd.it/7o1ty8
https://github.com/floyernick/fleep
/r/Python
https://redd.it/7o1ty8
GitHub
floyernick/fleep
fleep - File format determination library for Python
Best practices for building an API consumer? Is it good to have a different class defined for each end point?
I am working on a project that displays stats about users for the game Destiny 2. Part of it consists of lots of API requests for pulling in data about the users. I will be dealing with about a dozen different end points at the server. I'm new to django/apis, and wondering what the best strategy is for structuring things. I have not found much of anything written on this topic.
The big decision point I am facing now is whether to create an object corresponding to each end point. For instance:
class GetProfile:
base_url = 'http://destiny.core/getprofile/'
self.response = { }
def make_request(self, parameters):
<create session, make request, return response>
def extract_profile_data(self, response):
<pull pertinent information about user>
And I'd have one of those for each endpoint, e.g., GetUserStats.
I guess a key question is, What am I using this for? I am using the data to fill the database for a django project, so it will all go into model instances. Unfortunately, there isn't a 1:1 correspondence between endpoint and models: most model instances draw information from multiple endpoints. It seems objects like the above could provide useful as a container of information about a request, as well as methods for working with them.
Why am I asking this question at all? One random person online said that the above strategy is redundant, that responses in the requests library have enough structure, and urged me to just get the data and fill your database using more procedural programming. I feel like that person is wrong, but I am noob enough to really not be sure.
I just wanted to check in and see if there's any hive wisdom about this, obvious pitfalls or whatever, before I make this major design choice for my project.
/r/django
https://redd.it/7nyfvj
I am working on a project that displays stats about users for the game Destiny 2. Part of it consists of lots of API requests for pulling in data about the users. I will be dealing with about a dozen different end points at the server. I'm new to django/apis, and wondering what the best strategy is for structuring things. I have not found much of anything written on this topic.
The big decision point I am facing now is whether to create an object corresponding to each end point. For instance:
class GetProfile:
base_url = 'http://destiny.core/getprofile/'
self.response = { }
def make_request(self, parameters):
<create session, make request, return response>
def extract_profile_data(self, response):
<pull pertinent information about user>
And I'd have one of those for each endpoint, e.g., GetUserStats.
I guess a key question is, What am I using this for? I am using the data to fill the database for a django project, so it will all go into model instances. Unfortunately, there isn't a 1:1 correspondence between endpoint and models: most model instances draw information from multiple endpoints. It seems objects like the above could provide useful as a container of information about a request, as well as methods for working with them.
Why am I asking this question at all? One random person online said that the above strategy is redundant, that responses in the requests library have enough structure, and urged me to just get the data and fill your database using more procedural programming. I feel like that person is wrong, but I am noob enough to really not be sure.
I just wanted to check in and see if there's any hive wisdom about this, obvious pitfalls or whatever, before I make this major design choice for my project.
/r/django
https://redd.it/7nyfvj
Reducing the Variance of A/B Test using Prior Information
http://www.degeneratestate.org/posts/2018/Jan/04/reducing-the-variance-of-ab-test-using-prior-information/
/r/pystats
https://redd.it/7o19si
http://www.degeneratestate.org/posts/2018/Jan/04/reducing-the-variance-of-ab-test-using-prior-information/
/r/pystats
https://redd.it/7o19si
reddit
Reducing the Variance of A/B Test using Prior Information • r/pystats
3 points and 0 comments so far on reddit
Djangobook.com Has anyone read the book?
I am wondering if this book is worth buying? I have been reading the free tutorial and it is very good learning tool so far, better than the documentation because it is human readable.
/r/djangolearning
https://redd.it/7nzniv
I am wondering if this book is worth buying? I have been reading the free tutorial and it is very good learning tool so far, better than the documentation because it is human readable.
/r/djangolearning
https://redd.it/7nzniv
reddit
Djangobook.com Has anyone read the book? • r/djangolearning
I am wondering if this book is worth buying? I have been reading the free tutorial and it is very good learning tool so far, better than the...
[N] TensorFlow 1.5.0 Release Candidate
https://github.com/tensorflow/tensorflow/releases/tag/v1.5.0-rc0
/r/MachineLearning
https://redd.it/7o21w7
https://github.com/tensorflow/tensorflow/releases/tag/v1.5.0-rc0
/r/MachineLearning
https://redd.it/7o21w7
GitHub
tensorflow/tensorflow
tensorflow - Computation using data flow graphs for scalable machine learning
Hacking WiFi to inject cryptocurrency miner to HTML requests with Python
http://arnaucode.com/blog/coffeeminer-hacking-wifi-cryptocurrency-miner.html
/r/Python
https://redd.it/7o23lb
http://arnaucode.com/blog/coffeeminer-hacking-wifi-cryptocurrency-miner.html
/r/Python
https://redd.it/7o23lb
Shared db with restricted views per user.
I have a db that is to be shared. Where if a specific object has a certain value I need specific users to be able to see and edit it. No other users can see or edit these objects.
I am trying to understand what way one should do this. I don't know django very well. I am currently looking at conditionals for views. Not sure if that is even possible given i don't know if conditionals on views can filter objects from models.
If anyone could point me in the right direction I would greatly appreciate it.
/r/djangolearning
https://redd.it/7nqkiu
I have a db that is to be shared. Where if a specific object has a certain value I need specific users to be able to see and edit it. No other users can see or edit these objects.
I am trying to understand what way one should do this. I don't know django very well. I am currently looking at conditionals for views. Not sure if that is even possible given i don't know if conditionals on views can filter objects from models.
If anyone could point me in the right direction I would greatly appreciate it.
/r/djangolearning
https://redd.it/7nqkiu
reddit
Shared db with restricted views per user. • r/djangolearning
I have a db that is to be shared. Where if a specific object has a certain value I need specific users to be able to see and edit it. No other...
Wrecking ball animation in 14 lines of code in Blender 3d
http://slicker.me/blender/wreck.htm
/r/Python
https://redd.it/7o2xy3
http://slicker.me/blender/wreck.htm
/r/Python
https://redd.it/7o2xy3
slicker.me
Blender Python tutorial - wrecking ball effect in 14 lines of code
Community Curated Flask Resources [2018]
https://hackr.io/tutorials/learn-flask
/r/flask
https://redd.it/7o2t14
https://hackr.io/tutorials/learn-flask
/r/flask
https://redd.it/7o2t14
Hackr.io
Learn Flask - Best Flask Tutorials | Hackr.io
Learning Flask? Check out these best online Flask courses and tutorials recommended by the programming community. Pick the tutorial as per your learning style: video tutorials or a book. Free course or paid. Tutorials for beginners or advanced learners. Check…
The power of class based views
So the main (or one of them) reason to use class based views is to be able to display a list of objects in IndexView, and the details of that object in DetailView. But what if after the user clicks on an object in IndexView, I want to display another list of objects, and then when the user clicks on that, it will display details.
Example:
IndexView display's a list of categories. When the user clicks on a category it will display a list of sub-categories. When a subcategory is clicked, it will display details of that subcategory.
Thanks and sorry if my question is to basic!
/r/django
https://redd.it/7o15do
So the main (or one of them) reason to use class based views is to be able to display a list of objects in IndexView, and the details of that object in DetailView. But what if after the user clicks on an object in IndexView, I want to display another list of objects, and then when the user clicks on that, it will display details.
Example:
IndexView display's a list of categories. When the user clicks on a category it will display a list of sub-categories. When a subcategory is clicked, it will display details of that subcategory.
Thanks and sorry if my question is to basic!
/r/django
https://redd.it/7o15do
reddit
The power of class based views • r/django
So the main (or one of them) reason to use class based views is to be able to display a list of objects in IndexView, and the details of that...
Using Django with Discourse
Does anyone have experience integrating Discourse into their Django project? Was it difficult?
/r/django
https://redd.it/7o7dn0
Does anyone have experience integrating Discourse into their Django project? Was it difficult?
/r/django
https://redd.it/7o7dn0
reddit
Using Django with Discourse • r/django
Does anyone have experience integrating Discourse into their Django project? Was it difficult?
[AF] Where do you store abstractions for Redis commands? Same models folder as DB?
Hey everyone, I'm curious where you store functions that abstract out calls to redis. For example, I'd rather have a command like `active_users = get_active_users()` in my API controllers than long & ugly `active_users = json.loads(r.hget('users', 'active') or '[]')`calls. It feels to me like these should be organized alongside your models, but I'm not sure if this is common practice... or even what the common practice even is.
Thanks for any insight you can provide!
/r/flask
https://redd.it/7nzksv
Hey everyone, I'm curious where you store functions that abstract out calls to redis. For example, I'd rather have a command like `active_users = get_active_users()` in my API controllers than long & ugly `active_users = json.loads(r.hget('users', 'active') or '[]')`calls. It feels to me like these should be organized alongside your models, but I'm not sure if this is common practice... or even what the common practice even is.
Thanks for any insight you can provide!
/r/flask
https://redd.it/7nzksv
reddit
[AF] Where do you store abstractions for Redis commands?... • r/flask
Hey everyone, I'm curious where you store functions that abstract out calls to redis. For example, I'd rather have a command like `active_users =...
Groups as roles
Are django groups enough for a straightforward role based auth implementation?
/r/django
https://redd.it/7nv2z3
Are django groups enough for a straightforward role based auth implementation?
/r/django
https://redd.it/7nv2z3
reddit
Groups as roles • r/django
Are django groups enough for a straightforward role based auth implementation?
Python® Notes for Professionals book
http://books.goalkicker.com/PythonBook/
/r/Python
https://redd.it/7o3kl4
http://books.goalkicker.com/PythonBook/
/r/Python
https://redd.it/7o3kl4
Goalkicker
Free Python Programming Book
Getting started with Python Language, Python Data Types, Indentation, Comments and Documentation, Date and Time, Date Formatting, Enum, Set, Simple Mathematical Operators, Bitwise Operators, Boolean Operators, Operator Precedence, Variable Scope and Binding…
Related, does this ERD behind my flask app makes sense?
https://www.lucidchart.com/invitations/accept/74564e9f-4d85-422f-b217-a4ae4db92c0b
Above is My Lucidchart ERD which you can modify, if you do please make notations.
JPG: https://drive.google.com/open?id=1cN7nyYYlKG1D0HXCAWzSTM5xqAXoA0gK
Above is the ERD of the flask webapp i am developing. I am really new to python, flask and databases. So far i have only the listing table setup where i have several scrapers daily enter data into the table.
That side of my projects works as i want. Now i am creating a GUI webapp to visualize the data. Did some testing and have a bootstrap layout working. Now i have to rebuild the database from all the lose parts i have. I want to do this right this time so i dont waste any time forward with bad design.
So this is the setup.
Scraper scrapes specific url from a brance, this brance is a child of a company because some companies have serveral brances.
The scraper puts the new found listings in the listing table, and updates the remove/sold date if it can't find the listing or finds a soldmarker on the listing. The new thing i added is a sperate table for pricechanges so i can track if there are pricechanges and retrieve when.
* Every Listing has a brance and company
* Every company has a brance (even if they only have one) but not every compay has listings (if i don't track their listings but they subscribe to track others(targets))
I have the website login seperate because i like to keep it like this, it would let me add users without whole companies.
Did i choose the right 'intermediate' table for the price changes and for the targets (a companie can track several brances). ?
Also did i use the right crowfood notation? I am studying my ass off for 2 days on database/design and modelling them in sqlalchemy and i has been very hard to grasp it fully.
/r/flask
https://redd.it/7nth1d
https://www.lucidchart.com/invitations/accept/74564e9f-4d85-422f-b217-a4ae4db92c0b
Above is My Lucidchart ERD which you can modify, if you do please make notations.
JPG: https://drive.google.com/open?id=1cN7nyYYlKG1D0HXCAWzSTM5xqAXoA0gK
Above is the ERD of the flask webapp i am developing. I am really new to python, flask and databases. So far i have only the listing table setup where i have several scrapers daily enter data into the table.
That side of my projects works as i want. Now i am creating a GUI webapp to visualize the data. Did some testing and have a bootstrap layout working. Now i have to rebuild the database from all the lose parts i have. I want to do this right this time so i dont waste any time forward with bad design.
So this is the setup.
Scraper scrapes specific url from a brance, this brance is a child of a company because some companies have serveral brances.
The scraper puts the new found listings in the listing table, and updates the remove/sold date if it can't find the listing or finds a soldmarker on the listing. The new thing i added is a sperate table for pricechanges so i can track if there are pricechanges and retrieve when.
* Every Listing has a brance and company
* Every company has a brance (even if they only have one) but not every compay has listings (if i don't track their listings but they subscribe to track others(targets))
I have the website login seperate because i like to keep it like this, it would let me add users without whole companies.
Did i choose the right 'intermediate' table for the price changes and for the targets (a companie can track several brances). ?
Also did i use the right crowfood notation? I am studying my ass off for 2 days on database/design and modelling them in sqlalchemy and i has been very hard to grasp it fully.
/r/flask
https://redd.it/7nth1d
A SQLite Tutorial with Python
http://stackabuse.com/a-sqlite-tutorial-with-python/
/r/Python
https://redd.it/7o2ucx
http://stackabuse.com/a-sqlite-tutorial-with-python/
/r/Python
https://redd.it/7o2ucx
Stack Abuse
A SQLite Tutorial with Python
This tutorial will cover using SQLite in combination with Python's sqlite3 interface. SQLite is a single file relational database bundled with most standard Py...