JupyterLab Minimalist Container
I've been using containers to create isolated ML environments for a while now and have relied heavily on the awesome [Jupyter Docker Stacks](https://jupyter-docker-stacks.readthedocs.io/en/latest/index.html) project. Having stable, portable pre-configured environments ready to go has been awesome.
However, the minimalist in me wanted to slim down these images as they include much that I never used. And so I began working on a project I am calling [jupyterlab-minimalist-image](https://github.com/gitjeff05/jupyterlab-minimalist-image). Now open for feedback and requests.
In addition to making the images smaller, I wanted:
- A simple and intuitive Dockerfile (~20 lines)
- To be based off the [Official Python Docker image](https://hub.docker.com/_/python)
- Multi-stage builds
- A Reduction in dependencies (only what is necessary)
In the end I was able to make significant reductions when comparing to the `jupyter/scipy-notebook` image that I was using. Specifically, I saw a **%75** reduction in image size and an **%88** reduction in lines of Dockerfile:
| Image | # Layers | # lines in Dockerfile | Size (GB) |
|---|---|---|---|
| `jupyterlab-minimalist` | 10 | 22 | 0.663 |
| `jupyter/scipy-notebook` | 21 | 190 | 2.67 |
As I note in the docs, this is not exactly a fair comparison because the scipy image from Jupyter Docker
/r/JupyterNotebooks
https://redd.it/ifu0x5
I've been using containers to create isolated ML environments for a while now and have relied heavily on the awesome [Jupyter Docker Stacks](https://jupyter-docker-stacks.readthedocs.io/en/latest/index.html) project. Having stable, portable pre-configured environments ready to go has been awesome.
However, the minimalist in me wanted to slim down these images as they include much that I never used. And so I began working on a project I am calling [jupyterlab-minimalist-image](https://github.com/gitjeff05/jupyterlab-minimalist-image). Now open for feedback and requests.
In addition to making the images smaller, I wanted:
- A simple and intuitive Dockerfile (~20 lines)
- To be based off the [Official Python Docker image](https://hub.docker.com/_/python)
- Multi-stage builds
- A Reduction in dependencies (only what is necessary)
In the end I was able to make significant reductions when comparing to the `jupyter/scipy-notebook` image that I was using. Specifically, I saw a **%75** reduction in image size and an **%88** reduction in lines of Dockerfile:
| Image | # Layers | # lines in Dockerfile | Size (GB) |
|---|---|---|---|
| `jupyterlab-minimalist` | 10 | 22 | 0.663 |
| `jupyter/scipy-notebook` | 21 | 190 | 2.67 |
As I note in the docs, this is not exactly a fair comparison because the scipy image from Jupyter Docker
/r/JupyterNotebooks
https://redd.it/ifu0x5
GitHub
GitHub - gitjeff05/jupyterlab-minimalist-image: A lightweight Docker image for Python, JupterLab, Numpy, Pandas, Matplotlib and…
A lightweight Docker image for Python, JupterLab, Numpy, Pandas, Matplotlib and scikit-learn - GitHub - gitjeff05/jupyterlab-minimalist-image: A lightweight Docker image for Python, JupterLab, Nump...
A few months ago I asked the Django community here if anyone would be open to talk about their tech stack and lessons learned from using Django in production on a podcast I started. You crushed it! Here's some of the results
The original post was here: https://www.reddit.com/r/django/comments/gddnh0/are_you_running_any_type_of_django_app_in/
Since then:
- Over 30 people have filled out the form to become a guest on the show
- About 28 of those episodes have been recorded
- 12 of them are live on the podcast site as of this post
The Django specific episodes are at: https://runninginproduction.com/tags/django
Episodes range from a small team creating their own insurance company from scratch with a 300,000+ line Django app running on a Kubernetes cluster on AWS to folks who just deployed their first Django project on Heroku. Every episode has a different Django app with a different tech stack / story.
**I just wanted to say thank you to everyone who came on or happens to listen to any episode.**
The only downside is it will take a few more months to publish the rest of the episodes since it's a weekly show. With that said, if you don't mind waiting and you want to be a guest on the show, I'm always open to having new guests on! The form to get the ball rolling is here: https://docs.google.com/forms/d/e/1FAIpQLSdaCRorXztETX1rQxcYT67OTkF3BKb-max99RYpRPrEiO-sKw/viewform
/r/django
https://redd.it/ifrcd6
The original post was here: https://www.reddit.com/r/django/comments/gddnh0/are_you_running_any_type_of_django_app_in/
Since then:
- Over 30 people have filled out the form to become a guest on the show
- About 28 of those episodes have been recorded
- 12 of them are live on the podcast site as of this post
The Django specific episodes are at: https://runninginproduction.com/tags/django
Episodes range from a small team creating their own insurance company from scratch with a 300,000+ line Django app running on a Kubernetes cluster on AWS to folks who just deployed their first Django project on Heroku. Every episode has a different Django app with a different tech stack / story.
**I just wanted to say thank you to everyone who came on or happens to listen to any episode.**
The only downside is it will take a few more months to publish the rest of the episodes since it's a weekly show. With that said, if you don't mind waiting and you want to be a guest on the show, I'm always open to having new guests on! The form to get the ball rolling is here: https://docs.google.com/forms/d/e/1FAIpQLSdaCRorXztETX1rQxcYT67OTkF3BKb-max99RYpRPrEiO-sKw/viewform
/r/django
https://redd.it/ifrcd6
reddit
Are you running any type of Django app in production? I'd love to...
Hi, A few months ago I started a podcast to talk to folks about how they're running both small and large Django apps in production. For about an...
Learning React..converting frontend project?
Hey guys,
I have a project thats kind of on the large size. I wanted to convert it to react front and flask backend. What am I in for exactly?
/r/flask
https://redd.it/ifyd54
Hey guys,
I have a project thats kind of on the large size. I wanted to convert it to react front and flask backend. What am I in for exactly?
/r/flask
https://redd.it/ifyd54
reddit
Learning React..converting frontend project?
Hey guys, I have a project thats kind of on the large size. I wanted to convert it to react front and flask backend. What am I in for exactly?
A little help!
I have been working on a django project where i have used bootstrap forms. Now I want to that functionality where an user fills out the form then the form information gets stored in the database under corresponding field. Then the stored data gets displayed in the dashboard area. Can anyone tell me how could I achieve this?
/r/django
https://redd.it/ig8nbr
I have been working on a django project where i have used bootstrap forms. Now I want to that functionality where an user fills out the form then the form information gets stored in the database under corresponding field. Then the stored data gets displayed in the dashboard area. Can anyone tell me how could I achieve this?
/r/django
https://redd.it/ig8nbr
reddit
A little help!
I have been working on a django project where i have used bootstrap forms. Now I want to that functionality where an user fills out the form then...
Python Flask Tutorial - Bootstrap 5 Cards in Flask App - Homepage Design
https://www.youtube.com/watch?v=tLSVP1dy4-s
/r/flask
https://redd.it/ig9sop
https://www.youtube.com/watch?v=tLSVP1dy4-s
/r/flask
https://redd.it/ig9sop
YouTube
#5 Python Flask Tutorial - Bootstrap 5 Cards in Flask App - Homepage Design - Code Jana
Join Code Jana --- Flask Discord Server : https://discord.gg/78pgAs8ez6.
Share your issues & problems & chat with everyone regarding Python Flask web-framework. Hi coders, I adore you folks. In this video of Python Flask Tutorial series, we'll take a look…
Share your issues & problems & chat with everyone regarding Python Flask web-framework. Hi coders, I adore you folks. In this video of Python Flask Tutorial series, we'll take a look…
Free Python for Data Analytics Course
Hi,
I am a self-taught Analytics professional from a small town in India. I am a long time lurker here on Reddit and I finally have something to share with this community.
I have extensive experience in Python and Machine Learning working in companies like Citi Bank and Flipkart (a Walmart's subsidiary in India). I have created a small Python course all inside Jupyter Notebook. All you need to do is to import the notebook files and you can learn the topics and run the codes - all inside the notebook file itself. I believe that these notebooks will be more than enough for you to get started in Python and you might not need to do any other basic Python course online.
Jupyter Notebook files are available [here](https://github.com/ItsAwSM/Python-for-Data-Analytics).
I also have created videos on the notebooks if you need any added explanation. They are on my channel [here](https://www.youtube.com/c/UtsavAwasthiX/videos)
|| ज्ञानं परमं बलम् ||
(knowledge is power supreme)
/r/Python
https://redd.it/ifukmz
Hi,
I am a self-taught Analytics professional from a small town in India. I am a long time lurker here on Reddit and I finally have something to share with this community.
I have extensive experience in Python and Machine Learning working in companies like Citi Bank and Flipkart (a Walmart's subsidiary in India). I have created a small Python course all inside Jupyter Notebook. All you need to do is to import the notebook files and you can learn the topics and run the codes - all inside the notebook file itself. I believe that these notebooks will be more than enough for you to get started in Python and you might not need to do any other basic Python course online.
Jupyter Notebook files are available [here](https://github.com/ItsAwSM/Python-for-Data-Analytics).
I also have created videos on the notebooks if you need any added explanation. They are on my channel [here](https://www.youtube.com/c/UtsavAwasthiX/videos)
|| ज्ञानं परमं बलम् ||
(knowledge is power supreme)
/r/Python
https://redd.it/ifukmz
GitHub
GitHub - ItsAwSM/Python-for-Data-Analytics: This course will teach you only the relevant topics in Python for starting your career…
This course will teach you only the relevant topics in Python for starting your career in Data Analytics. There are also a bunch of tips and tricks throughout for resume writing, solving case studi...
What's everyone working on this week?
Tell /r/python what you're working on this week! You can be bragging, grousing, sharing your passion, or explaining your pain. Talk about your current project or your pet project; whatever you want to share.
/r/Python
https://redd.it/igcx24
Tell /r/python what you're working on this week! You can be bragging, grousing, sharing your passion, or explaining your pain. Talk about your current project or your pet project; whatever you want to share.
/r/Python
https://redd.it/igcx24
reddit
What's everyone working on this week?
Tell /r/python what you're working on this week! You can be bragging, grousing, sharing your passion, or explaining your pain. Talk about your...
[P] easyOCR API
Hi, I'd like to introduce easyOCR API which is simple, easy, and ready to use right away.
Rest API is available:
curl -X POST "[https://master-easy-ocr-wook-2.endpoint.ainize.ai/word\_extraction](https://master-easy-ocr-wook-2.endpoint.ainize.ai/word_extraction?fbclid=IwAR0e9WmwOqh15Wj4cC-h-mv-duizdNKk1efZy34scYIKc1L33Je0QMi2lxI)" -H "accept: images/\*" -H "Content-Type: multipart/form-data" -F "language=ko" -F "base\_image=canmachinesthink.png;type=image/png"
github: [https://github.com/JaidedAI/EasyOCR](https://github.com/JaidedAI/EasyOCR)
demo: [https://github.com/wook-2/easyOCR](https://github.com/wook-2/easyOCR)
[https://master-easy-ocr-wook-2.endpoint.ainize.ai/](https://master-easy-ocr-wook-2.endpoint.ainize.ai/)
/r/MachineLearning
https://redd.it/ig4x6g
Hi, I'd like to introduce easyOCR API which is simple, easy, and ready to use right away.
Rest API is available:
curl -X POST "[https://master-easy-ocr-wook-2.endpoint.ainize.ai/word\_extraction](https://master-easy-ocr-wook-2.endpoint.ainize.ai/word_extraction?fbclid=IwAR0e9WmwOqh15Wj4cC-h-mv-duizdNKk1efZy34scYIKc1L33Je0QMi2lxI)" -H "accept: images/\*" -H "Content-Type: multipart/form-data" -F "language=ko" -F "base\_image=canmachinesthink.png;type=image/png"
github: [https://github.com/JaidedAI/EasyOCR](https://github.com/JaidedAI/EasyOCR)
demo: [https://github.com/wook-2/easyOCR](https://github.com/wook-2/easyOCR)
[https://master-easy-ocr-wook-2.endpoint.ainize.ai/](https://master-easy-ocr-wook-2.endpoint.ainize.ai/)
/r/MachineLearning
https://redd.it/ig4x6g
GitHub
GitHub - JaidedAI/EasyOCR: Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese…
Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc. - JaidedAI/EasyOCR
How to load a jupyter-notebook without executing the cells
I want to give a presentation using Jupyter Notebook. But when I load my prepared
notebook, all the cells are executed/evaluated.
Q: How can I load my prepared notebook without executing/evaluating any cell (and let me do so one by one)?
THANKS!
/r/IPython
https://redd.it/ige19q
I want to give a presentation using Jupyter Notebook. But when I load my prepared
notebook, all the cells are executed/evaluated.
Q: How can I load my prepared notebook without executing/evaluating any cell (and let me do so one by one)?
THANKS!
/r/IPython
https://redd.it/ige19q
reddit
How to load a jupyter-notebook without executing the cells
I want to give a presentation using Jupyter Notebook. But when I load my prepared notebook, all the cells are executed/evaluated. Q: How...
Files inside my Static folder are not being found when running on server.
I am having issues relating the Django documentation for settings up the static path ways to how my project is set up.
I am using a Droplet on Digital Ocean that is setup to use Django 3.1, Gunicorn, and Nginx to run my project and the static files load locally but throw a 404 error on the droplet server. I feel like I've tried every combination of STATIC_URL, STATIC_ROOT, and STATICFILES_DIRS i can think of and I've copied the static files using "collectstatic" so I'm pretty desperate for suggestions.
This is the path in the actual server to the static path I copied my project too:
**/home/django/django_project/django_project/static**
I've tried setting my variables to this setup:
STATIC_URL = '/static/' # I've tried this too: 'django_project/django_project/static/'
STATIC_ROOT = "/var/www/static/" #'/static/'
STATICFILES_DIRS = [
os.path.join(BASE_DIR, '/static'), #I've tried 'django_project/static' with and without the back slash at the end
]
No matter what I try the static assets cannot be found:
/r/djangolearning
https://redd.it/iggkpx
I am having issues relating the Django documentation for settings up the static path ways to how my project is set up.
I am using a Droplet on Digital Ocean that is setup to use Django 3.1, Gunicorn, and Nginx to run my project and the static files load locally but throw a 404 error on the droplet server. I feel like I've tried every combination of STATIC_URL, STATIC_ROOT, and STATICFILES_DIRS i can think of and I've copied the static files using "collectstatic" so I'm pretty desperate for suggestions.
This is the path in the actual server to the static path I copied my project too:
**/home/django/django_project/django_project/static**
I've tried setting my variables to this setup:
STATIC_URL = '/static/' # I've tried this too: 'django_project/django_project/static/'
STATIC_ROOT = "/var/www/static/" #'/static/'
STATICFILES_DIRS = [
os.path.join(BASE_DIR, '/static'), #I've tried 'django_project/static' with and without the back slash at the end
]
No matter what I try the static assets cannot be found:
/r/djangolearning
https://redd.it/iggkpx
reddit
Files inside my Static folder are not being found when running on...
I am having issues relating the Django documentation for settings up the static path ways to how my project is set up. I am using a Droplet on...
Hello Ananconda Users! I am a newbie and I have installed and uninstalled this application two times (to troubleshoot this). I can't open the navigator as it is showing me this error. I have gone with the PATH thing as well. Please direct me. Thank you!
/r/JupyterNotebooks
https://redd.it/igcmm5
/r/JupyterNotebooks
https://redd.it/igcmm5
[D] What are the free services using GPT-3 that I can try?
Something along the lines of PhilosopherAI.
Thanks
/r/MachineLearning
https://redd.it/igavbq
Something along the lines of PhilosopherAI.
Thanks
/r/MachineLearning
https://redd.it/igavbq
reddit
[D] What are the free services using GPT-3 that I can try?
Something along the lines of PhilosopherAI. Thanks
15+ Free Python Projects for Beginners with full tutorial walkthroughs
https://www.codewithrepl.it/python-projects-for-beginners.html
/r/Python
https://redd.it/ig81x0
https://www.codewithrepl.it/python-projects-for-beginners.html
/r/Python
https://redd.it/ig81x0
ModuleNotFoundError: No module named 'googleapiclient'
This is my code I'm running in a **Python3 Jupyter notebook**:
from __future__ import print_function
import datetime
from googleapiclient.discovery import build
from httplib2 import Http
from oauth2client import file, client, tools
import pandas as pd
​
I get this error:
> **ModuleNotFoundError**: No module named 'googleapiclient'
​
**pip freeze:**
This is what I get from the command `pip freeze:`
apiclient==1.0.4
astroid==2.3.3
attrs==18.1.0
beautifulsoup4==4.7.1
cachetools==4.1.1
certifi==2020.6.20
chardet==3.0.4
colorama==0.4.3
ConfigArgParse==0.14.0
coursera-dl==0.11.4
cycler==0.10.0
entrypoints==0.3
google-api-core==1.22.1
google-api-python-client==1.10.0
google-auth==1.20.1
google-auth-httplib2==0.0.4
google-auth-oauthlib==0.4.1
googleapis-common-protos==1.52.0
httplib2==0.18.1
idna==2.10
isort==4.3.21
keyring==19.0.1
kiwisolver==1.2.0
lazy-object-proxy==1.4.3
matplotlib==3.3.0
mccabe==0.6.1
numpy==1.19.1
oauth2client==4.1.3
oauthlib==3.1.0
pandas==1.1.0
Pillow==7.2.0
/r/JupyterNotebooks
https://redd.it/igbdg4
This is my code I'm running in a **Python3 Jupyter notebook**:
from __future__ import print_function
import datetime
from googleapiclient.discovery import build
from httplib2 import Http
from oauth2client import file, client, tools
import pandas as pd
​
I get this error:
> **ModuleNotFoundError**: No module named 'googleapiclient'
​
**pip freeze:**
This is what I get from the command `pip freeze:`
apiclient==1.0.4
astroid==2.3.3
attrs==18.1.0
beautifulsoup4==4.7.1
cachetools==4.1.1
certifi==2020.6.20
chardet==3.0.4
colorama==0.4.3
ConfigArgParse==0.14.0
coursera-dl==0.11.4
cycler==0.10.0
entrypoints==0.3
google-api-core==1.22.1
google-api-python-client==1.10.0
google-auth==1.20.1
google-auth-httplib2==0.0.4
google-auth-oauthlib==0.4.1
googleapis-common-protos==1.52.0
httplib2==0.18.1
idna==2.10
isort==4.3.21
keyring==19.0.1
kiwisolver==1.2.0
lazy-object-proxy==1.4.3
matplotlib==3.3.0
mccabe==0.6.1
numpy==1.19.1
oauth2client==4.1.3
oauthlib==3.1.0
pandas==1.1.0
Pillow==7.2.0
/r/JupyterNotebooks
https://redd.it/igbdg4
reddit
ModuleNotFoundError: No module named 'googleapiclient'
This is my code I'm running in a **Python3 Jupyter notebook**: from __future__ import print_function import datetime from...
PyCon India 2020
Ticket sales for PyConIndia 2020 are open.
To make the event inclusive and accessible to all, we have kept the ticket prices to a bare minimum of 199 INR, or roughly 2.68 USD.
Rush to grab your regular tickets now.
[https://in.pycon.org/2020/#ticket](https://in.pycon.org/2020/#ticket)
Regards,
On Behalf of PyCon India Organising Team
/r/flask
https://redd.it/igeavg
Ticket sales for PyConIndia 2020 are open.
To make the event inclusive and accessible to all, we have kept the ticket prices to a bare minimum of 199 INR, or roughly 2.68 USD.
Rush to grab your regular tickets now.
[https://in.pycon.org/2020/#ticket](https://in.pycon.org/2020/#ticket)
Regards,
On Behalf of PyCon India Organising Team
/r/flask
https://redd.it/igeavg
reddit
PyCon India 2020
Ticket sales for PyConIndia 2020 are open. To make the event inclusive and accessible to all, we have kept the ticket prices to a bare...
Wednesday megathread: Beginner questions
New to Python and have questions? Use this thread to ask anything about Python, there are no bad questions!
/r/Python
https://redd.it/igo5yy
New to Python and have questions? Use this thread to ask anything about Python, there are no bad questions!
/r/Python
https://redd.it/igo5yy
reddit
r/Python - Wednesday megathread: Beginner questions
5 votes and 2 comments so far on Reddit
Codes in the earlier cells are not being carried down to the lower cells?
Why is everything defined in cells earlier (plus imported stuff) are undefined when I call them in another cell (when I try to run just that cell, not the entire notebook from start)?
Is this the expected behavior? Am I suppose to run the entire notebook every time I want to see the change I made?
/r/IPython
https://redd.it/igq1ep
Why is everything defined in cells earlier (plus imported stuff) are undefined when I call them in another cell (when I try to run just that cell, not the entire notebook from start)?
Is this the expected behavior? Am I suppose to run the entire notebook every time I want to see the change I made?
/r/IPython
https://redd.it/igq1ep
reddit
Codes in the earlier cells are not being carried down to the lower...
Why is everything defined in cells earlier (plus imported stuff) are undefined when I call them in another cell (when I try to run just that cell,...
Way to send multiple files with a loop
Hello everyone,
I’ve been learning Python for a few months and I’m very new to Flask. I have an application that will take a csv and then perform a function returning multiple csv’s after looping to separate them out based on a filter. The problem I’m running into is that send_file must be returned and can not be yielded, thus my loop is terminated after one iteration.
The only other potential solution I have seen is to zip the files and then return that, but I am trying to avoid this.
Is there anything I am missing here that could help me achieve what I’m trying to do?
Thank you in advance for any help!
/r/flask
https://redd.it/igo435
Hello everyone,
I’ve been learning Python for a few months and I’m very new to Flask. I have an application that will take a csv and then perform a function returning multiple csv’s after looping to separate them out based on a filter. The problem I’m running into is that send_file must be returned and can not be yielded, thus my loop is terminated after one iteration.
The only other potential solution I have seen is to zip the files and then return that, but I am trying to avoid this.
Is there anything I am missing here that could help me achieve what I’m trying to do?
Thank you in advance for any help!
/r/flask
https://redd.it/igo435
reddit
Way to send multiple files with a loop
Hello everyone, I’ve been learning Python for a few months and I’m very new to Flask. I have an application that will take a csv and then...
A Proof of Concept to Semi-Automates the roles of Internet Moderators. We even built our own Social Media Platform to test on it :))
https://github.com/axenhammer/CODAR
/r/flask
https://redd.it/iguxoc
https://github.com/axenhammer/CODAR
/r/flask
https://redd.it/iguxoc
GitHub
GitHub - axenhammer/CODAR: ✅ CODAR is a framework built using PyTorch to analyze post (Text+Media) and predict cyber bullying and…
✅ CODAR is a framework built using PyTorch to analyze post (Text+Media) and predict cyber bullying and offensive content. - GitHub - axenhammer/CODAR: ✅ CODAR is a framework built using PyTorch to ...
Setup of Dockerised Flask/Fast-api to perform Background tasks using celery and Redis
Minimal example utilizing Flask/Fast-Api and celery with Redis for celery
back-end and task queue and
flower for monitoring the celery tasks.
1. [Flask](https://github.com/jitendrasinghiitg/docker-flask-celery-redis)
2. [Fastapi](https://github.com/jitendrasinghiitg/docker-fastapi-celery)
Hope it might be useful to someone
/r/flask
https://redd.it/igxr3s
Minimal example utilizing Flask/Fast-Api and celery with Redis for celery
back-end and task queue and
flower for monitoring the celery tasks.
1. [Flask](https://github.com/jitendrasinghiitg/docker-flask-celery-redis)
2. [Fastapi](https://github.com/jitendrasinghiitg/docker-fastapi-celery)
Hope it might be useful to someone
/r/flask
https://redd.it/igxr3s
GitHub
jitendrasinghiitg/docker-flask-celery-redis
Minimal example utilizing Flask and celery with Redis for celery back-end and task queue, and flower for monitoring the celery tasks. - jitendrasinghiitg/docker-flask-celery-redis