TLJH GPU management
Hello everyone,
I just joined this community, and this is my first message here. I am a second-year student studying SE in Serbia. I've set up JupyterHub from my Ubuntu server, which runs on 8GPUS. I am looking to restrict and manage GPU resources for the users of JupyterHub.Some schemes would look like this:
\-Admin
|- user1: 2 usable GPUs
|- user2: 3 usable GPUs
|- user3: 4 usable GPUs
|- user4: 1 usable GPU
​
I looked through documentation from links( such as:
\-[https://medium.com/rapids-ai/setting-up-gpu-data-science-environments-for-hackathons-cdb52e7781a5](https://medium.com/rapids-ai/setting-up-gpu-data-science-environments-for-hackathons-cdb52e7781a5)
\-[https://developer.nvidia.com/blog/cuda-pro-tip-control-gpu-visibility-cuda\_visible\_devices/](https://developer.nvidia.com/blog/cuda-pro-tip-control-gpu-visibility-cuda_visible_devices/)
\-[https://tljh.jupyter.org/en/latest/topic/tljh-config.html](https://tljh.jupyter.org/en/latest/topic/tljh-config.html)
Trust me, my first three pages of google are purple :D ), and I could not find the particular thing that is suitable for me and working. This is what I have so far, and with sudo tljh-config show:
users:
admin:
- skynet
allowed:
- good-user_1
- marko
limits:
memory: 4G
marko:
CUDA_VISIBLE_DEVICES: 0,1,2
https:
enabled: true
user_environment:
default_app: jupyterhub
/r/JupyterNotebooks
https://redd.it/xk34ub
Hello everyone,
I just joined this community, and this is my first message here. I am a second-year student studying SE in Serbia. I've set up JupyterHub from my Ubuntu server, which runs on 8GPUS. I am looking to restrict and manage GPU resources for the users of JupyterHub.Some schemes would look like this:
\-Admin
|- user1: 2 usable GPUs
|- user2: 3 usable GPUs
|- user3: 4 usable GPUs
|- user4: 1 usable GPU
​
I looked through documentation from links( such as:
\-[https://medium.com/rapids-ai/setting-up-gpu-data-science-environments-for-hackathons-cdb52e7781a5](https://medium.com/rapids-ai/setting-up-gpu-data-science-environments-for-hackathons-cdb52e7781a5)
\-[https://developer.nvidia.com/blog/cuda-pro-tip-control-gpu-visibility-cuda\_visible\_devices/](https://developer.nvidia.com/blog/cuda-pro-tip-control-gpu-visibility-cuda_visible_devices/)
\-[https://tljh.jupyter.org/en/latest/topic/tljh-config.html](https://tljh.jupyter.org/en/latest/topic/tljh-config.html)
Trust me, my first three pages of google are purple :D ), and I could not find the particular thing that is suitable for me and working. This is what I have so far, and with sudo tljh-config show:
users:
admin:
- skynet
allowed:
- good-user_1
- marko
limits:
memory: 4G
marko:
CUDA_VISIBLE_DEVICES: 0,1,2
https:
enabled: true
user_environment:
default_app: jupyterhub
/r/JupyterNotebooks
https://redd.it/xk34ub
Medium
Setting up GPU Data Science Environments for Hackathons
AKA Littlest CUDA Hub
Reinforcement Learning for Beginners - coding a Maze-solving agent from scratch
https://strikingloo.github.io/reinforcement-learning-beginners
/r/Python
https://redd.it/xkr98k
https://strikingloo.github.io/reinforcement-learning-beginners
/r/Python
https://redd.it/xkr98k
Reinforcement Learning for Beginners - Python Tutorial
Introduction to Reinforcement Learning. I explain the Sarsa algorithm, code an example from scratch in Python, and teach an AI to solve mazes.
Jupyter Community Workshop: The Future of Jupyter Widgets
https://blog.jupyter.org/jupyter-community-workshop-the-future-of-jupyter-widgets-475f67288da0
/r/IPython
https://redd.it/xjq9tv
https://blog.jupyter.org/jupyter-community-workshop-the-future-of-jupyter-widgets-475f67288da0
/r/IPython
https://redd.it/xjq9tv
Medium
Jupyter Community Workshop: The Future of Jupyter Widgets
After a long break from in-person events, we are excited to announce an in-person Jupyter Community Workshop!
This media is not supported in your browser
VIEW IN TELEGRAM
I made a small demo app for creating an image slider using JSONField
https://redd.it/xl1aps
@pythondaily
https://redd.it/xl1aps
@pythondaily
Web Applications in Production using Flask, Gunicorn WSGI and Nginx
https://writersbyte.com/featured-post/web-apps-with-flask-gunicorn-nginx/
/r/flask
https://redd.it/xldv0w
https://writersbyte.com/featured-post/web-apps-with-flask-gunicorn-nginx/
/r/flask
https://redd.it/xldv0w
WritersByte
Web Applications in Production using Flask, Gunicorn WSGI and Nginx (Part 2/3) - WritersByte
In our previous tutorial of this series, we looked at how we could deploy deep learning based web applications by strategically structuring our Flask project,
The 8 surprising ways how to use Jupyter Notebook
https://mljar.com/blog/how-to-use-jupyter-notebook/
/r/IPython
https://redd.it/v0vc2f
https://mljar.com/blog/how-to-use-jupyter-notebook/
/r/IPython
https://redd.it/v0vc2f
MLJAR
The 8 surprising ways how to use Jupyter Notebook
Explore the Jupyter Notebook beyond its traditional use. Discover 8 alternative ways to utilize this versatile tool, making it even more powerful for coding, experimentation, and collaboration.
Django ADFS Question
Hello my application uses Django ADFS using Azure AD. It works as it should be I cannot seem to figure out how to get the users role from Azure or the package. Was wondering if anyone knew how to print out the users role as there is two groups users and admins
/r/django
https://redd.it/xlx8n6
Hello my application uses Django ADFS using Azure AD. It works as it should be I cannot seem to figure out how to get the users role from Azure or the package. Was wondering if anyone knew how to print out the users role as there is two groups users and admins
/r/django
https://redd.it/xlx8n6
reddit
Django ADFS Question
Hello my application uses Django ADFS using Azure AD. It works as it should be I cannot seem to figure out how to get the users role from Azure or...
Seeking professional data scientists for research study - 30 min virtual interview, compensation provided
Hello! My name is Aayushi Roy, I’m part of a research team at the University of Maryland studying how data scientists collaborate. We’re looking for professional data scientists to participate in a research interview study about how data scientists work together to perform data analysis (flyer).
Participants will be asked a set of questions regarding their collaborative environment and what tools they use to perform data analysis. The study will take about 30 minutes to complete and will be held over Zoom. Upon successful completion of the interview, participants will receive $20 in compensation.
Responses will be anonymized. This study has been approved by the Institutional Review Board at the University of Maryland, College Park.
To be eligible, you must:
- Be at least 18 years old
- Work with data and perform data science work as part of your job description
- Use computational notebooks
- Have experience in data science tools/workflows
Participation will entail:
- Completing a pre-study demographics questionnaire (5 minutes)
- Answering interview questions about your collaborative environment and the tools you use (30 min)
If you are or someone you know is interested, please DM me or email me at aroy2530@umd.edu. Thank you for your time and consideration!
/r/JupyterNotebooks
https://redd.it/xm1mku
Hello! My name is Aayushi Roy, I’m part of a research team at the University of Maryland studying how data scientists collaborate. We’re looking for professional data scientists to participate in a research interview study about how data scientists work together to perform data analysis (flyer).
Participants will be asked a set of questions regarding their collaborative environment and what tools they use to perform data analysis. The study will take about 30 minutes to complete and will be held over Zoom. Upon successful completion of the interview, participants will receive $20 in compensation.
Responses will be anonymized. This study has been approved by the Institutional Review Board at the University of Maryland, College Park.
To be eligible, you must:
- Be at least 18 years old
- Work with data and perform data science work as part of your job description
- Use computational notebooks
- Have experience in data science tools/workflows
Participation will entail:
- Completing a pre-study demographics questionnaire (5 minutes)
- Answering interview questions about your collaborative environment and the tools you use (30 min)
If you are or someone you know is interested, please DM me or email me at aroy2530@umd.edu. Thank you for your time and consideration!
/r/JupyterNotebooks
https://redd.it/xm1mku
Make Your Matplotlib Plots Stand Out Using This Cheat Sheet
https://pub.towardsai.net/make-your-matplotlib-plots-stand-out-using-this-cheat-sheet-8c666de90433
/r/IPython
https://redd.it/uyv4m4
https://pub.towardsai.net/make-your-matplotlib-plots-stand-out-using-this-cheat-sheet-8c666de90433
/r/IPython
https://redd.it/uyv4m4
Medium
Make Your Matplotlib Plots Stand Out Using This Cheat Sheet
Cheat sheet for editing the background, ticks, and annotations in Matplotlib
How can I display my machine learning model in Jupyter Notebooks?
https://youtu.be/x-alwfgQ-cY Following this interesting tutorial and want to know how to display this in the frontend. Can I use React? Other alternatives I can use?
/r/JupyterNotebooks
https://redd.it/xju16a
https://youtu.be/x-alwfgQ-cY Following this interesting tutorial and want to know how to display this in the frontend. Can I use React? Other alternatives I can use?
/r/JupyterNotebooks
https://redd.it/xju16a
YouTube
Build A Book Recommendation System With Machine Learning [part 1 of 2]
In this video, we'll learn how to build a system to recommend new books for you to read. We'll start by downloading the data, which was scraped from Goodreads. The data files are large (hundreds of millions of rows), so we'll learn some tricks to process…
The Definitive Guide to Graph Problems
https://www.giulianopertile.com/blog/the-definitive-guide-to-graph-problems/
/r/Python
https://redd.it/xlvtwd
https://www.giulianopertile.com/blog/the-definitive-guide-to-graph-problems/
/r/Python
https://redd.it/xlvtwd
Giulianopertile
The Definitive Guide to Graph Problems | Giuliano Pertile
Do you want to learn how to solve graph problems? Are you preparing for a coding interview? Do you want to polish your problem-solving skills? In this article I will try to answer these questions and more, and you will learn the patterns necessary to deal…
I wrote my first real scripts today
I’m a water resource engineer by trade, learning to code partially for fun and partially in the hopes of making my job easier. Today I needed to convert a whole bunch of files from one format to another, edit some particular values in the header, and convert to a third format. Rather than spend all day doing it by hand, I spent all day writing a script that does it in seconds…and it works!
It’s a piddling little script, only about 50 lines, but it does exactly what I want it to do, and now in the future when I have to deal with this process again, I’ll be armed and ready.
I know this is nothing revolutionary, but honestly it feels pretty good to write working code to address a real life problem! Hopefully the next one goes a bit faster…
/r/Python
https://redd.it/xlgo4a
I’m a water resource engineer by trade, learning to code partially for fun and partially in the hopes of making my job easier. Today I needed to convert a whole bunch of files from one format to another, edit some particular values in the header, and convert to a third format. Rather than spend all day doing it by hand, I spent all day writing a script that does it in seconds…and it works!
It’s a piddling little script, only about 50 lines, but it does exactly what I want it to do, and now in the future when I have to deal with this process again, I’ll be armed and ready.
I know this is nothing revolutionary, but honestly it feels pretty good to write working code to address a real life problem! Hopefully the next one goes a bit faster…
/r/Python
https://redd.it/xlgo4a
reddit
I wrote my first real scripts today
I’m a water resource engineer by trade, learning to code partially for fun and partially in the hopes of making my job easier. Today I needed to...
Brainfried: A Brainfuck to Assembly Compiler
A while back I worked on a project called Brainfried which takes Brainfuck source code and compiles it to Intel x86 64 assembly which then gets compiled using nasm. Because Brainfried compiles to assembly unlike a lot of other Brainfuck programs which interpret the code. Brainfried runs a lot faster.
Right now, because the generated assembly works of syscalls. It can only be used with Linux
/r/Python
https://redd.it/xm8n2h
A while back I worked on a project called Brainfried which takes Brainfuck source code and compiles it to Intel x86 64 assembly which then gets compiled using nasm. Because Brainfried compiles to assembly unlike a lot of other Brainfuck programs which interpret the code. Brainfried runs a lot faster.
Right now, because the generated assembly works of syscalls. It can only be used with Linux
/r/Python
https://redd.it/xm8n2h
GitHub
GitHub - ScriptLineStudios/Brainfried: A brainfuck compiler
A brainfuck compiler. Contribute to ScriptLineStudios/Brainfried development by creating an account on GitHub.
How can I use crispy-forms with bootstrap-select?
I want to replace the crispy-forms default bootstrap select with the bootstrap-select (https://developer.snapappointments.com/bootstrap-select/)
​
It's like I'm fighting an uphill battle. I tried adding the "selectpicker" class to the widget but then the bootstrap-select appears INSIDE a normal bootstrap select. Then I tried defining my own field element for crispy-forms but now the bootstrap-select is not aligned with the rest of the form, it's missing the little required star, etc....
​
Is there an easy way to do this?
​
My form (I want the State to be a selectpicker):
class AddressForm(forms.Form):
email = forms.CharField(widget=forms.TextInput(attrs={"placeholder": "email"}))
password = forms.CharField(widget=forms.PasswordInput())
address1 = forms.CharField(
label="Address", widget=forms.TextInput(attrs={"placeholder": "1234 Main St"})
)
address2 = forms.CharField(
widget=forms.TextInput(attrs={"placeholder": "Apartment, studio, or floor"})
)
city = forms.CharField()
state = forms.ChoiceField(choices=STATES)
/r/django
https://redd.it/xm3fzx
I want to replace the crispy-forms default bootstrap select with the bootstrap-select (https://developer.snapappointments.com/bootstrap-select/)
​
It's like I'm fighting an uphill battle. I tried adding the "selectpicker" class to the widget but then the bootstrap-select appears INSIDE a normal bootstrap select. Then I tried defining my own field element for crispy-forms but now the bootstrap-select is not aligned with the rest of the form, it's missing the little required star, etc....
​
Is there an easy way to do this?
​
My form (I want the State to be a selectpicker):
class AddressForm(forms.Form):
email = forms.CharField(widget=forms.TextInput(attrs={"placeholder": "email"}))
password = forms.CharField(widget=forms.PasswordInput())
address1 = forms.CharField(
label="Address", widget=forms.TextInput(attrs={"placeholder": "1234 Main St"})
)
address2 = forms.CharField(
widget=forms.TextInput(attrs={"placeholder": "Apartment, studio, or floor"})
)
city = forms.CharField()
state = forms.ChoiceField(choices=STATES)
/r/django
https://redd.it/xm3fzx
Snapappointments
Getting Started | bootstrap-select · SnapAppointments Developer
The jQuery plugin that brings select elements into the 21st century with intuitive multiselection, searching, and much more. Now with Bootstrap 4 support.
Could I use Django to create a fully functional employee scheduling system?
I'm thinking to use Django, React and PostgreSQL. I'm a newbie that just started working with Django (and coding in general) about half a year ago. I haven't done anything too crazy complex but I wanted to see if I could challenge myself to build an employee scheduler since it's something I could see really improving my uncle's life. My biggest question is, could I use Django for this? I know it's a powerful framework but I haven't really unlocked its full potential yet Here is the use case:
My uncle has to schedule hundreds of employees across 25\~ stores. He has to manually set schedules every month which is really painful as you might imagine since you have to ensure that every restaurant has enough staff at all times, employee time constraints and there are some floating managers that go where they are needed. I would love to be able to have a UI where my uncle can store employee info like their names, employee id, position, store, hours they can work, their pay rate, etc. I could see this as a microservice all on its own.
Another microservice can be restaurants' details which includes all the store hours
/r/django
https://redd.it/xmbidx
I'm thinking to use Django, React and PostgreSQL. I'm a newbie that just started working with Django (and coding in general) about half a year ago. I haven't done anything too crazy complex but I wanted to see if I could challenge myself to build an employee scheduler since it's something I could see really improving my uncle's life. My biggest question is, could I use Django for this? I know it's a powerful framework but I haven't really unlocked its full potential yet Here is the use case:
My uncle has to schedule hundreds of employees across 25\~ stores. He has to manually set schedules every month which is really painful as you might imagine since you have to ensure that every restaurant has enough staff at all times, employee time constraints and there are some floating managers that go where they are needed. I would love to be able to have a UI where my uncle can store employee info like their names, employee id, position, store, hours they can work, their pay rate, etc. I could see this as a microservice all on its own.
Another microservice can be restaurants' details which includes all the store hours
/r/django
https://redd.it/xmbidx
reddit
Could I use Django to create a fully functional employee...
I'm thinking to use Django, React and PostgreSQL. I'm a newbie that just started working with Django (and coding in general) about half a year...
500 internal server error
I have jupyter notebook installed with conda which was done a few years ago. Just recently I've installed the latest version of python using pip and also installed jupyter notebook. When I use the terminal to run jupyter notebook I can open it but then I get a internal server error when trying to open the file. Is this because it conflicts with my existing jupyter notebook with conda? And if so how do I resolve this issue?
/r/JupyterNotebooks
https://redd.it/xizhr4
I have jupyter notebook installed with conda which was done a few years ago. Just recently I've installed the latest version of python using pip and also installed jupyter notebook. When I use the terminal to run jupyter notebook I can open it but then I get a internal server error when trying to open the file. Is this because it conflicts with my existing jupyter notebook with conda? And if so how do I resolve this issue?
/r/JupyterNotebooks
https://redd.it/xizhr4
reddit
500 internal server error
I have jupyter notebook installed with conda which was done a few years ago. Just recently I've installed the latest version of python using pip...
Best practice for an app with ML?
I'm working in project that uses ML for recommendation purposes. However, the ML part is implemented in a Fast API as another server. The problem is that since the ML part is in another app, the Django app must send request to this app and then retrieve it which causes a noticible performance delay.
Mind you, these requests are pretty frequent and are even worse in a deployed environment as the both apps are deployed seperatly.
My partner said that this is common in apps that utilize AI and is the best practic. However, I don't think this fits our case and introduces many issues that don't need to be solved. I think that we could just implement the whole in Django itself rather easily.
If you have had experience with a similar issue, I welcome your insight. What is really the best practice for project like this? Would it be better to just implement it in Django instead of using two separate apps?
/r/django
https://redd.it/xmtl92
I'm working in project that uses ML for recommendation purposes. However, the ML part is implemented in a Fast API as another server. The problem is that since the ML part is in another app, the Django app must send request to this app and then retrieve it which causes a noticible performance delay.
Mind you, these requests are pretty frequent and are even worse in a deployed environment as the both apps are deployed seperatly.
My partner said that this is common in apps that utilize AI and is the best practic. However, I don't think this fits our case and introduces many issues that don't need to be solved. I think that we could just implement the whole in Django itself rather easily.
If you have had experience with a similar issue, I welcome your insight. What is really the best practice for project like this? Would it be better to just implement it in Django instead of using two separate apps?
/r/django
https://redd.it/xmtl92
reddit
Best practice for an app with ML?
I'm working in project that uses ML for recommendation purposes. However, the ML part is implemented in a Fast API as another server. The problem...
Force the users to change the password before first login
Hi Guys,
I have a question about Flask, or better: about Flask-Security. I’m working on an app that should help to complete specific tasks as a team. I implemented Flask-Security-Too to handle login, logout, password change and very important to have certain user roles. However, users should be registered by admins only. The admin will set an initial password, that must be changed by the user before the first login. Admins will also be able to reset the password by changing it to a temporally one, which must then be changed by the user after it is used for login.
I’ve seen this concept in a lot of other apps and was wondering if it could be implemented with Flask/Flask-Security. And if yes, what would be the most practicable/secure way.
Any thoughts? :)
/r/flask
https://redd.it/xmxegk
Hi Guys,
I have a question about Flask, or better: about Flask-Security. I’m working on an app that should help to complete specific tasks as a team. I implemented Flask-Security-Too to handle login, logout, password change and very important to have certain user roles. However, users should be registered by admins only. The admin will set an initial password, that must be changed by the user before the first login. Admins will also be able to reset the password by changing it to a temporally one, which must then be changed by the user after it is used for login.
I’ve seen this concept in a lot of other apps and was wondering if it could be implemented with Flask/Flask-Security. And if yes, what would be the most practicable/secure way.
Any thoughts? :)
/r/flask
https://redd.it/xmxegk
reddit
Force the users to change the password before first login
Hi Guys, I have a question about Flask, or better: about Flask-Security. I’m working on an app that should help to complete specific tasks as a...
Why django over asp.net core?
C# is a statically typed languages so you don’t really need to write tests to expose compile time issues in asp.net core whereas in django it is really necessary. Additionally the number of requests handled by asp.net core seems far superior than django (I found somewhere else a ratio of 10:6). So why do you all still use django?
I am looking for an honest opinions to present to my non-technical management that our decision to go with django over asp.net core is good.
We did go with django especially considering django admin panel, so we don’t need to write a lot of code but ask some of our stakeholders to complete a few things using django admin panel. This indeed decreased the delivery time. However now we found using different external tools the stakeholders could do the things still if we just provide them the database tables. Thank you.
/r/django
https://redd.it/xmpepd
C# is a statically typed languages so you don’t really need to write tests to expose compile time issues in asp.net core whereas in django it is really necessary. Additionally the number of requests handled by asp.net core seems far superior than django (I found somewhere else a ratio of 10:6). So why do you all still use django?
I am looking for an honest opinions to present to my non-technical management that our decision to go with django over asp.net core is good.
We did go with django especially considering django admin panel, so we don’t need to write a lot of code but ask some of our stakeholders to complete a few things using django admin panel. This indeed decreased the delivery time. However now we found using different external tools the stakeholders could do the things still if we just provide them the database tables. Thank you.
/r/django
https://redd.it/xmpepd
reddit
Why django over asp.net core?
C# is a statically typed languages so you don’t really need to write tests to expose compile time issues in asp.net core whereas in django it is...
ModuleNotFoundError: No module named 'Crypto' and more issues
Base Github I am using: bookwyrm-social/bookwyrm: Social reading and reviewing, decentralized with ActivityPub (github.com)
My Fork of team fork: cmorgan2016/bookwyrm-genres: Social reading and reviewing, decentralized with ActivityPub (github.com)
Note: I am struggling to get commit to work
Their tutorial: [Developer Environment (joinbookwyrm.com)](https://docs.joinbookwyrm.com/install-dev.html)
What I am using: Git Bash and Virtual Studio Code
what happen when I debug:
crbug/1173575, non-JS module files deprecated. chromewebdata/(index)꞉6564:22:6789
https://preview.redd.it/hivvzp9fu0q91.png?width=730&format=png&auto=webp&s=3e58397c0085dfdf03e96b2d7569765134977ed6
I'm getting this error when I run $ python [manage.py](https://manage.py) makemigrations --merge and I have run
pip install Crypto
pip install pycrypto
pip install pycryptodome
When I run ./bw-dev build
+ case "$CMD" in
+ docker-compose build
Error response from daemon: i/o timeout: driver not connecting
When I run ./bw-dev setup
+ case "$CMD" in
+ migrate
+ runweb python manage.py migrate
+ docker-compose run --rm web python manage.py migrate
Error response from daemon: i/o timeout
When I run ./bw-dev up
+ case "$CMD" in
+ docker-compose up
/r/djangolearning
https://redd.it/xnqbjw
Base Github I am using: bookwyrm-social/bookwyrm: Social reading and reviewing, decentralized with ActivityPub (github.com)
My Fork of team fork: cmorgan2016/bookwyrm-genres: Social reading and reviewing, decentralized with ActivityPub (github.com)
Note: I am struggling to get commit to work
Their tutorial: [Developer Environment (joinbookwyrm.com)](https://docs.joinbookwyrm.com/install-dev.html)
What I am using: Git Bash and Virtual Studio Code
what happen when I debug:
crbug/1173575, non-JS module files deprecated. chromewebdata/(index)꞉6564:22:6789
https://preview.redd.it/hivvzp9fu0q91.png?width=730&format=png&auto=webp&s=3e58397c0085dfdf03e96b2d7569765134977ed6
I'm getting this error when I run $ python [manage.py](https://manage.py) makemigrations --merge and I have run
pip install Crypto
pip install pycrypto
pip install pycryptodome
When I run ./bw-dev build
+ case "$CMD" in
+ docker-compose build
Error response from daemon: i/o timeout: driver not connecting
When I run ./bw-dev setup
+ case "$CMD" in
+ migrate
+ runweb python manage.py migrate
+ docker-compose run --rm web python manage.py migrate
Error response from daemon: i/o timeout
When I run ./bw-dev up
+ case "$CMD" in
+ docker-compose up
/r/djangolearning
https://redd.it/xnqbjw
GitHub
GitHub - bookwyrm-social/bookwyrm: Social reading and reviewing, decentralized with ActivityPub
Social reading and reviewing, decentralized with ActivityPub - bookwyrm-social/bookwyrm