[R] AdaBound: An optimizer that trains as fast as Adam and as good as SGD (ICLR 2019), with A PyTorch Implementation
Hi! I am an undergrad doing research in the field of ML/DL/NLP. This is my first time to write a post on Reddit. :D
We developed a new optimizer called **AdaBound**, hoping to achieve a faster training speed as well as better performance on unseen data. Our paper, *Adaptive Gradient Methods with Dynamic Bound of Learning Rate*, has been accepted by ICLR 2019 and we just updated the camera ready version on open review.
I am very excited that a PyTorch implementation of AdaBound is publicly available now, and a PyPI package has been released as well. You may install and try AdaBound easily via `pip` or directly copying & pasting. I also wrote a post to introduce this lovely new optimizer.
​
Here's some quick links:
**Website:** [https://www.luolc.com/publications/adabound/](https://www.luolc.com/publications/adabound/)
**GitHub:** [https://github.com/Luolc/AdaBound](https://github.com/Luolc/AdaBound)
**Open Review:** [https://openreview.net/forum?id=Bkg3g2R9FX](https://openreview.net/forum?id=Bkg3g2R9FX)
**Abstract:**
Adaptive optimization methods such as AdaGrad, RMSprop and Adam have been proposed to achieve a rapid training process with an element-wise scaling term on learning rates. Though prevailing, they are observed to generalize poorly compared with SGD or even fail to converge due to unstable and extreme learning rates. Recent work has put forward some algorithms such as AMSGrad to tackle this issue but they failed to achieve considerable improvement over existing methods. In
/r/MachineLearning
https://redd.it/auvj3q
Hi! I am an undergrad doing research in the field of ML/DL/NLP. This is my first time to write a post on Reddit. :D
We developed a new optimizer called **AdaBound**, hoping to achieve a faster training speed as well as better performance on unseen data. Our paper, *Adaptive Gradient Methods with Dynamic Bound of Learning Rate*, has been accepted by ICLR 2019 and we just updated the camera ready version on open review.
I am very excited that a PyTorch implementation of AdaBound is publicly available now, and a PyPI package has been released as well. You may install and try AdaBound easily via `pip` or directly copying & pasting. I also wrote a post to introduce this lovely new optimizer.
​
Here's some quick links:
**Website:** [https://www.luolc.com/publications/adabound/](https://www.luolc.com/publications/adabound/)
**GitHub:** [https://github.com/Luolc/AdaBound](https://github.com/Luolc/AdaBound)
**Open Review:** [https://openreview.net/forum?id=Bkg3g2R9FX](https://openreview.net/forum?id=Bkg3g2R9FX)
**Abstract:**
Adaptive optimization methods such as AdaGrad, RMSprop and Adam have been proposed to achieve a rapid training process with an element-wise scaling term on learning rates. Though prevailing, they are observed to generalize poorly compared with SGD or even fail to converge due to unstable and extreme learning rates. Recent work has put forward some algorithms such as AMSGrad to tackle this issue but they failed to achieve considerable improvement over existing methods. In
/r/MachineLearning
https://redd.it/auvj3q
Luolc
Adaptive Gradient Methods with Dynamic Bound of Learning Rate
Abstract Adaptive optimization methods such as AdaGrad, RMSProp and Adam have been proposed to achieve a rapid training process with an element-wise scaling term on learning rates. Though prevailing, they are observed to generalize poorly compared with Sgd…
Just created my first web app using Flask and have a noob question
First off, Flask is really awesome. I’ve been programming for about 4 months now, and building this application was really cool, challenging, and sort of inspiring. The question I have is: is it possible to create the web server on say a Raspberry Pi, and then access it remotely from another machine? If so where would I look to learn how to do this?
/r/flask
https://redd.it/auipte
First off, Flask is really awesome. I’ve been programming for about 4 months now, and building this application was really cool, challenging, and sort of inspiring. The question I have is: is it possible to create the web server on say a Raspberry Pi, and then access it remotely from another machine? If so where would I look to learn how to do this?
/r/flask
https://redd.it/auipte
reddit
r/flask - Just created my first web app using Flask and have a noob question
14 votes and 12 comments so far on Reddit
Trouble with creating Dynamic forms
I am trying to create an application that displays a list of various questions.
Each question response in the list should be one of the following:
1. StringField()
2. SelectField()
The questions are dynamically generated from a database.
I am having trouble dynamically creating these form fields.
/r/flask
https://redd.it/auqmg5
I am trying to create an application that displays a list of various questions.
Each question response in the list should be one of the following:
1. StringField()
2. SelectField()
The questions are dynamically generated from a database.
I am having trouble dynamically creating these form fields.
/r/flask
https://redd.it/auqmg5
reddit
r/flask - Trouble with creating Dynamic forms
1 vote and 1 comment so far on Reddit
creating event model with recurring dates
hello.
im working on a project where users can list their events. In each event, it could either be a one-day event or a recurring event. How can I implement this application?
I've looked at other packages like django-scheduling, django-recurrence, and django-eventtools, but I don't know if they are compatible with Django 2.1.
It would be cool if anyone have any experience with these packages, and know if they are up to date with the current django version.
I am also willing to implement my own version of this system, but I do not know where to start.
thank you.
Edit: With this recurring events, is it possible to search for them based on date ranges
/r/djangolearning
https://redd.it/aujbg2
hello.
im working on a project where users can list their events. In each event, it could either be a one-day event or a recurring event. How can I implement this application?
I've looked at other packages like django-scheduling, django-recurrence, and django-eventtools, but I don't know if they are compatible with Django 2.1.
It would be cool if anyone have any experience with these packages, and know if they are up to date with the current django version.
I am also willing to implement my own version of this system, but I do not know where to start.
thank you.
Edit: With this recurring events, is it possible to search for them based on date ranges
/r/djangolearning
https://redd.it/aujbg2
reddit
r/djangolearning - creating event model with recurring dates
3 votes and 3 comments so far on Reddit
This media is not supported in your browser
VIEW IN TELEGRAM
Django Jet admin interface 2.0 is now compatible with any stack with SQL database
/r/django
https://redd.it/av0dlp
/r/django
https://redd.it/av0dlp
The Django Packages site needs a redesign ASAP
I hope i'm not the only one who really hate browsing it. Its really a bad showcase for the framework (let alone a web framework) when you can't even search packages on mobile. The comparison tables are also not responsive on mobile.
I'd really wish it had a better design. Take Laravel for example: [https://packalyst.com/](https://packalyst.com/)
​
Sorry, just had to get it out. lol.
​
​
​
/r/django
https://redd.it/auy8kl
I hope i'm not the only one who really hate browsing it. Its really a bad showcase for the framework (let alone a web framework) when you can't even search packages on mobile. The comparison tables are also not responsive on mobile.
I'd really wish it had a better design. Take Laravel for example: [https://packalyst.com/](https://packalyst.com/)
​
Sorry, just had to get it out. lol.
​
​
​
/r/django
https://redd.it/auy8kl
What's everyone working on this week?
Tell /r/python what you're working on this week! You can be bragging, grousing, sharing your passion, or explaining your pain. Talk about your current project or your pet project; whatever you want to share.
/r/Python
https://redd.it/auzuns
Tell /r/python what you're working on this week! You can be bragging, grousing, sharing your passion, or explaining your pain. Talk about your current project or your pet project; whatever you want to share.
/r/Python
https://redd.it/auzuns
reddit
r/Python - What's everyone working on this week?
0 votes and 9 comments so far on Reddit
How to create choices based on file contents
I have a json object, where I would like each of the entries in the json file to be options choosable by the user, such that the user can select multiple options and those choices can be saved somewhere, can someone point me in the right direction?
Thanks
/r/django
https://redd.it/av2kjc
I have a json object, where I would like each of the entries in the json file to be options choosable by the user, such that the user can select multiple options and those choices can be saved somewhere, can someone point me in the right direction?
Thanks
/r/django
https://redd.it/av2kjc
reddit
r/django - How to create choices based on file contents
0 votes and 0 comments so far on Reddit
Build a Data Analysis Library from Scratch in Python
Hey All,
[Build a Data Analysis Library from Scratch in Python](https://www.youtube.com/playlist?list=PLVyhfExBT1XDTu-oocI3ttl_OPhulAJOp) is a course I've developed to help those looking for a long, comprehensive project that will teach advanced Python and basic software development. It seems that there is a lack of these types of projects for those who possess the fundamentals of Python, but haven't put together a complete project.
The end result is a library called Pandas Cub which is built to mimic the pandas library. There are 40 steps with nearly 100 pre-written unit tests that must be passed in order to complete the project. The project not only teaches advanced Python but environment setup, test-driven development, and developing code outside of a Jupyter Notebook. The project can also be [found on GitHub](https://github.com/tdpetrou/pandas_cub).
I hope its useful and if you have critical feedback please let me know.
/r/Python
https://redd.it/av0awc
Hey All,
[Build a Data Analysis Library from Scratch in Python](https://www.youtube.com/playlist?list=PLVyhfExBT1XDTu-oocI3ttl_OPhulAJOp) is a course I've developed to help those looking for a long, comprehensive project that will teach advanced Python and basic software development. It seems that there is a lack of these types of projects for those who possess the fundamentals of Python, but haven't put together a complete project.
The end result is a library called Pandas Cub which is built to mimic the pandas library. There are 40 steps with nearly 100 pre-written unit tests that must be passed in order to complete the project. The project not only teaches advanced Python but environment setup, test-driven development, and developing code outside of a Jupyter Notebook. The project can also be [found on GitHub](https://github.com/tdpetrou/pandas_cub).
I hope its useful and if you have critical feedback please let me know.
/r/Python
https://redd.it/av0awc
YouTube
Build a Data Analysis Library from Scratch in Python
Get course notes here - https://github.com/tdpetrou/pandas_cub
Hunting for Memory Leaks in Python applications
https://medium.com/zendesk-engineering/hunting-for-memory-leaks-in-python-applications-6824d0518774
/r/Python
https://redd.it/av4a2y
https://medium.com/zendesk-engineering/hunting-for-memory-leaks-in-python-applications-6824d0518774
/r/Python
https://redd.it/av4a2y
Medium
Hunting for Memory Leaks in Python applications
We use Python a fair bit at Zendesk for building machine learning (ML) products. One of the common performance issues we encountered with…
Geodjango OSMWidget coordinates are wrong.
I'm using an OSMWidget for my PointField(). I had already set my initial coordinates to 120, 14 but when I retrieve the values from my widget I get values around 13468873 and 1639089.
Also I am not saving any (spatial?) objects to my db because I want to stick to one db but I do need the coordinates as Decimal values to measure distances in the future.
Is there a way to convert widget values into standard coordinates?
/r/django
https://redd.it/av86my
I'm using an OSMWidget for my PointField(). I had already set my initial coordinates to 120, 14 but when I retrieve the values from my widget I get values around 13468873 and 1639089.
Also I am not saving any (spatial?) objects to my db because I want to stick to one db but I do need the coordinates as Decimal values to measure distances in the future.
Is there a way to convert widget values into standard coordinates?
/r/django
https://redd.it/av86my
reddit
r/django - Geodjango OSMWidget coordinates are wrong.
0 votes and 0 comments so far on Reddit
Python in Visual Studio Code - February 2019 Release
https://devblogs.microsoft.com/python/python-in-visual-studio-code-february-2019-release/
/r/Python
https://redd.it/avalbi
https://devblogs.microsoft.com/python/python-in-visual-studio-code-february-2019-release/
/r/Python
https://redd.it/avalbi
Python
Python in Visual Studio Code - February 2019 Release
We are pleased to announce that the February 2019 release of the Python Extension for Visual Studio Code is now available. You can download the Python extension from the Visual Studio Marketplace, or install it directly from the extension gallery in Visual…
[Django + javascript] Sending Post (submit) after given time
Hello r/django \- I am very new to django and javascript so I would appreciate any comments!
I am building a website where users can take math exams for free. The way my website works is very simple - a user writes down an answer (or chooses from a radio button) and clicks on the next button for the next question. Clicking on the next button also sends a POST request to my django views where I save the user's answer in my database.
Everything was working fine until I added a timer in javascript (when the exam time is over, the user is directed to the home page). Since the 'next' button was never clicked, the answer to the last question the user was working on is not saved. I would like to figure out a way to have my javascript code send a POST request to my django views when the timer is over.
​
I would appreciate any help. Thank you!
/r/django
https://redd.it/avb7r1
Hello r/django \- I am very new to django and javascript so I would appreciate any comments!
I am building a website where users can take math exams for free. The way my website works is very simple - a user writes down an answer (or chooses from a radio button) and clicks on the next button for the next question. Clicking on the next button also sends a POST request to my django views where I save the user's answer in my database.
Everything was working fine until I added a timer in javascript (when the exam time is over, the user is directed to the home page). Since the 'next' button was never clicked, the answer to the last question the user was working on is not saved. I would like to figure out a way to have my javascript code send a POST request to my django views when the timer is over.
​
I would appreciate any help. Thank you!
/r/django
https://redd.it/avb7r1
reddit
r/django - [Django + javascript] Sending Post (submit) after given time
0 votes and 0 comments so far on Reddit
Intercooler.js vs Stimulus.js vs Vue.js in Django
I'm mainly working on websites that have **little to to medium** interactions with the user, and i'm looking for ways to add JS to my sites without complicating things. SPA are out of the question since the sites needs to be SEO friendly. When i say interactions i mean stuff like upvote / downvote events, adding interactive tables and charts, popups with dynamic content and stuff like that.
​
* **Intercooler.js** \- Seems like the best candidate for Django at the moment but it feels incomplete.
* **Stimulus.js** \- Also seems nice, but it lacks a proper documentation with good examples. It also looks like its mostly meant for Ruby on Rails (?).
* **Vue.js** \- Is really clean and simple, but it seems like including it in Django templates can get messy for larger projects.
* **Nuxt.js** \- Is probably the best solution overall but it has a full separation of backed and fronted. This one requires a full dedication because i need to master both vue.js and nuxt.js to properly use it.
​
Besides pure JS, what do you guys use for this kind of projects?
​
​
/r/django
https://redd.it/avbv0p
I'm mainly working on websites that have **little to to medium** interactions with the user, and i'm looking for ways to add JS to my sites without complicating things. SPA are out of the question since the sites needs to be SEO friendly. When i say interactions i mean stuff like upvote / downvote events, adding interactive tables and charts, popups with dynamic content and stuff like that.
​
* **Intercooler.js** \- Seems like the best candidate for Django at the moment but it feels incomplete.
* **Stimulus.js** \- Also seems nice, but it lacks a proper documentation with good examples. It also looks like its mostly meant for Ruby on Rails (?).
* **Vue.js** \- Is really clean and simple, but it seems like including it in Django templates can get messy for larger projects.
* **Nuxt.js** \- Is probably the best solution overall but it has a full separation of backed and fronted. This one requires a full dedication because i need to master both vue.js and nuxt.js to properly use it.
​
Besides pure JS, what do you guys use for this kind of projects?
​
​
/r/django
https://redd.it/avbv0p
reddit
r/django - Intercooler.js vs Stimulus.js vs Vue.js in Django
0 votes and 3 comments so far on Reddit
Data getting reset on a singleton model
So I'm using a singleton class to save settings like google analytics id, keys related to third party services etc and other data that are static but may need to be updated via frontend.
But apparently, the data is getting reset almost every 2 weeks.
This is my mode
from django.db import models
from django.core.cache import cache
class SingletonModel(models.Model):
class Meta:
abstract = True
def set_cache(self):
cache.set(self.__class__.__name__, self)
def save(self, *args, **kwargs):
self.pk = 1
super(SingletonModel, self).save(*args, **kwargs)
self.set_cache()
def delete(self, *args, **kwargs):
pass
@classmethod
def load(cls):
/r/django
https://redd.it/avazuz
So I'm using a singleton class to save settings like google analytics id, keys related to third party services etc and other data that are static but may need to be updated via frontend.
But apparently, the data is getting reset almost every 2 weeks.
This is my mode
from django.db import models
from django.core.cache import cache
class SingletonModel(models.Model):
class Meta:
abstract = True
def set_cache(self):
cache.set(self.__class__.__name__, self)
def save(self, *args, **kwargs):
self.pk = 1
super(SingletonModel, self).save(*args, **kwargs)
self.set_cache()
def delete(self, *args, **kwargs):
pass
@classmethod
def load(cls):
/r/django
https://redd.it/avazuz
reddit
r/django - Data getting reset on a singleton model
1 vote and 1 comment so far on Reddit
Getting the url from an incoming request?
There are two Flask services, each running on a different port on localhost. Service A is a routing service that receives commands from a server and routes them to the appropriate instance of the Service B. There will eventually be hundreds of instances of Service B, each in its own docker container, so when it starts up, I want it to let Service A know where it is running.
I've created an endpoint in service A '/register' that accepts a post request, but I can't figure out how to get the host and port number dynamically.
request.remote_addr just gives me '127.0.0.1'
request.environ.get('REMOTE_PORT') returns 60702, which is NOT the port I'm running it on (9999).
Alternatively, is there a way in a Flask app to dynamically retrieve the URL and Port that the app itself is running on? Because then Service B could just put its own url in the request json.
Sorry if I wasn't clear enough, but I'm beating my head against the wall here
/r/flask
https://redd.it/av51ig
There are two Flask services, each running on a different port on localhost. Service A is a routing service that receives commands from a server and routes them to the appropriate instance of the Service B. There will eventually be hundreds of instances of Service B, each in its own docker container, so when it starts up, I want it to let Service A know where it is running.
I've created an endpoint in service A '/register' that accepts a post request, but I can't figure out how to get the host and port number dynamically.
request.remote_addr just gives me '127.0.0.1'
request.environ.get('REMOTE_PORT') returns 60702, which is NOT the port I'm running it on (9999).
Alternatively, is there a way in a Flask app to dynamically retrieve the URL and Port that the app itself is running on? Because then Service B could just put its own url in the request json.
Sorry if I wasn't clear enough, but I'm beating my head against the wall here
/r/flask
https://redd.it/av51ig
reddit
r/flask - Getting the url from an incoming request?
9 votes and 4 comments so far on Reddit
[P] Open source machine learning platform for developers
Hi all,
We recently open sourced the first version of our machine learning platform. My friend and I started getting into machine learning engineering a little over a year ago, and we were frustrated by how hard it was to get a simple machine learning application up and running on cloud infrastructure. We felt like we were spending way too much time configuring data pipelines, managing dependencies, and solving common problems like applying the same data transformations at training and inference time. Our project automates a lot of the underlying infrastructure work to help developers avoid dealing with the same challenges we had to.
We’d love to hear your feedback!
[https://github.com/cortexlabs/cortex](https://github.com/cortexlabs/cortex)
/r/MachineLearning
https://redd.it/av7o14
Hi all,
We recently open sourced the first version of our machine learning platform. My friend and I started getting into machine learning engineering a little over a year ago, and we were frustrated by how hard it was to get a simple machine learning application up and running on cloud infrastructure. We felt like we were spending way too much time configuring data pipelines, managing dependencies, and solving common problems like applying the same data transformations at training and inference time. Our project automates a lot of the underlying infrastructure work to help developers avoid dealing with the same challenges we had to.
We’d love to hear your feedback!
[https://github.com/cortexlabs/cortex](https://github.com/cortexlabs/cortex)
/r/MachineLearning
https://redd.it/av7o14
GitHub
GitHub - cortexlabs/cortex: Production infrastructure for machine learning at scale
Production infrastructure for machine learning at scale - cortexlabs/cortex
Jinja vs Flask Files - Which is best?
I'm still very new to Flask and Jinja.
If I use an API that returns a JSON object that I want to display via render\_template; is it best to pass the entire JSON object to the template and handle it in Jinja, or should I only pass the parts of the JSON object to Jinja.
Or does it not matter? Is there no real benefit to either approach?
/r/flask
https://redd.it/av8lv8
I'm still very new to Flask and Jinja.
If I use an API that returns a JSON object that I want to display via render\_template; is it best to pass the entire JSON object to the template and handle it in Jinja, or should I only pass the parts of the JSON object to Jinja.
Or does it not matter? Is there no real benefit to either approach?
/r/flask
https://redd.it/av8lv8
reddit
r/flask - Jinja vs Flask Files - Which is best?
1 vote and 2 comments so far on Reddit