Django bugfix release issued: 5.1.3
https://www.djangoproject.com/weblog/2024/nov/05/bugfix-release/

/r/django
https://redd.it/1gk09ri

Tuesday Daily Thread: Advanced questions

# Weekly Wednesday Thread: Advanced Questions 🐍

Dive deep into Python with our Advanced Questions thread! This space is reserved for questions about more advanced Python topics, frameworks, and best practices.

## How it Works:

1. **Ask Away**: Post your advanced Python questions here.
2. **Expert Insights**: Get answers from experienced developers.
3. **Resource Pool**: Share or discover tutorials, articles, and tips.

## Guidelines:

* This thread is for **advanced questions only**. Beginner questions are welcome in our [Daily Beginner Thread](#daily-beginner-thread-link) every Thursday.
* Questions that are not advanced may be removed and redirected to the appropriate thread.

## Recommended Resources:

* If you don't receive a response, consider exploring r/LearnPython or join the [Python Discord Server](https://discord.gg/python) for quicker assistance.

## Example Questions:

1. **How can you implement a custom memory allocator in Python?**
2. **What are the best practices for optimizing Cython code for heavy numerical computations?**
3. **How do you set up a multi-threaded architecture using Python's Global Interpreter Lock (GIL)?**
4. **Can you explain the intricacies of metaclasses and how they influence object-oriented design in Python?**
5. **How would you go about implementing a distributed task queue using Celery and RabbitMQ?**
6. **What are some advanced use-cases for Python's decorators?**
7. **How can you achieve real-time data streaming in Python with WebSockets?**
8. **What are the

/r/Python
https://redd.it/1gjtaue

Rio: WebApps in pure Python – A fresh Layouting System

Hey everyone!

We received a lot of encouraging feedback from you and used it to improve our framework. For all who are not familiar with our framework, Rio is an easy-to-use framework for creating websites and apps which is based entirely on Python.

From all the feedback the most common question we've encountered is, "How does Rio actually work?" Last time we shared our concept about components (what are components, how does observing attributes, diffing, and reconciliation work).

Now we want to share our concept of our own fresh layouting system for Rio. In our wiki we share our thoughts on:

* What Makes a Great Layout System
* Our system in Rio with a 2-step-approach
* Limitations of our approach

Feel free to check out our Wiki on our [Layouting System](https://github.com/rio-labs/rio/wiki/Layouting-System).

Take a look at our playground, where you can try out our layout concept firsthand with just a click and receive real-time feedback: [Rio - Layouting Quickstart](https://rio.dev/docs/howto/layout-guide)

Thanks and we are looking forward to your feedback! :)

[Github: Rio](https://github.com/rio-labs/rio)

/r/Python
https://redd.it/1gjgcsf

Task queue with asyncio support

I like Django for it's time and battle tested codebase. Its ORM is super intuitive to use. DRF fills in the gaps which allows me to define Schemas for my request validation and expose APIs as OpenAPI spec.

I process simple CURD requests within Django. For long running tasks, I am looking out to select a library which supports

* asyncio natively (I should be able to define my tasks as `async def`) [ Most of my long running jobs are io intensive and async native library will help me there ].
* ability to handle Django ORM use cases in the async tasks, like fetching and saving database objects (preferably using `sync_to_async`) till Django comes up with native support for asyncio in their ORM
* ability to send tasks to rabbitmq instead of redis (I like the stronger "exactly once", "message acknowledgement", "custom routing" etc. guarantees and functionalities provided by rabbitmq).

I have started to develop strong dislike for Celery's pre-forking model. The workers seem to crash without any particular reason, with Signal 11, Signal 5 etc. Celery does not also have async support natively, and I feel discomfort in monkey patching it using gevent.

Has anyone run into similar requirements? How did you

/r/django
https://redd.it/1gk3p5m

Staff Software Engineer VS Principal Software Engineer VS Senior Software Engineer

I have seen these positions all over linked in, however, what do they do? I have never seen Django as a requirement for one of those positions, what is the difference between them and a backend developer? are they full stack... I am clueless

/r/django
https://redd.it/1gk5x3w

Blog Post: State of Python 3.13 Performance: Free-Threading

https://codspeed.io/blog/state-of-python-3-13-performance-free-threading

/r/Python
https://redd.it/1gk6azd

Introducing jinpro -- Vue/React like components, all in Flask and Jinja

Hey all! Longtime lurker here.

I always really enjoyed the syntax of custom components in Vue, React, and other .JS frameworks, but hated the overhead of those frameworks, and also don't really like Javascript that much (if I did, I'd learn Node.js).

I checked high and low for something that did what I want, but the only one is a library called JinjaX -- and no matter how many times I read the documentation, it simply did not work on my machine. No errors, just... didn't do anything.

So, I write a really simple and small preprocessor that allows for this kind of behavior.
In essence, you create a file (like Button.jinja) and define what arguments it takes. Then, in your jinja templates for other pages, you call it like an HTML tag -- <Button color="red">Click ME!</Button>.

Finally, rather than using the built-in render_template function, you use the JinjaProcessor.render function, which behaves exactly like Jinja's render_template -- except it looks for those capital-letter tags, renders them into HTML with the template context, and then renders the whole page. It also works recursively, so components can call on other components (like a PageLayout calling on a Navbar).

It's available on github and PyPI (through pip).

jinpro on PyPI

jinpro

/r/flask
[https://redd.it/1gk1kg6

Help Django to reach 80k stars on GitHub 🌟

Django's first commit dates back to 2005 🚀

In all these years, it has freely shared all the new features 🤗

If you've ever used Django, put a star on its GitHub repository and share this post 🔄

https://github.com/django/django

/r/django
https://redd.it/1gk7y75

What Free Host Providers do you Use for deploying RESTful API ?

Until this moment I had using Render which provides a free limited plan for deoloying Python or any other API, pythonanywhere is another option which allow deploying for free.

If you're testing a project you need to deploy the API, where you do it for free?

/r/Python
https://redd.it/1gk5ayh

Flask OpenAPI Generation?

I've been exploring Python frameworks as part of my blog on Python OpenAPI generation and I was quite surprised to see that Flask requires an extension like flask-smorest to generate an OpenAPI specification. Is OpenAPI just not popular in the Flask API community or is smorest just so good that built-in support is not needed?

/r/flask
https://redd.it/1gkcdnu

Effect size calculation for Repeated measures Anova

Hello! Im running an analysis using python's statsmodels rm anova method. I have a 2 way repeated measures anova analysis and a series of 1 way repeated measures anovas. I want to calculate the effect sizes.

Since there isn't a direct function for retrieving the partial eta square measure, I figured I would have to calculate it. But to do that I require the sum of squares values. As far as I can tell, I can't retrieve those values either.

So my questions are:
1. Is there a way to retrieve or compute the sum of squares values? (Maybe I just missed it?)
2. Can I calculate the partial eta square value using the variables in the anova table (like the f value, degrees of freedom, p value etc)?

/r/pystats
https://redd.it/1gkbqjv

ELI5: Flask vs React (framework vs. library)

Flask: a micro-framework
React: a library

Since react is a library and libraries are considered to be un-opinionated, how is the (very proudly un-opinionated) Flask still considered a framework? is it due to routing, wsgi, etc. out of the box?

/r/flask
https://redd.it/1gkhr2i

R Never Train from scratch

https://arxiv.org/pdf/2310.02980

The authors show that when transformers are pre trained, they can match the performance with S4 on the Long range Arena benchmark.

/r/MachineLearning
https://redd.it/1gk7dny

Data analytics

Hi, I’m in a course on data analytics - our teacher keeps saying that we will find our niche within the spectrum of visualisation, machine learning or coding.
I’m not sure how that works? Like how are we supposed to get better at visualisation without mastering coding. At times he says coding is important if you are interested in becoming a junior data analyst. how does the job market work? Can someone explain it to me? I’m not sure where my strength lies.

/r/IPython
https://redd.it/1gkhjzb

Bokeh Plot Problem

Hi all, I'm trying to have two bokeh plots in a flask app with bootstrap columns. I need two.

They are setup as an html and one is loading fine and the other is not showing up.

In my main app.py:

#tell flask to read dashboard page
@app.route('/dashboard')
def dashboard():
# Read content of plot1.html
    with open("plot1.html", "r") as f:
        plot1_html = f.read()
   
    # Read content of plot2.html
    with open("plot2.html", "r") as f:
        plot2_html = f.read()
   
    # Pass both plots to the template
    return render_template("dashboard.html", plot1_html=plot1_html, plot2_html=plot2_html)

In the dashboard.html:

 <!-- map and chart in bootstrap setup-->
        <div class="container-fluid">
            <div class="row">
                <div class="col-md-6">
     

/r/flask
https://redd.it/1gkiu8s

Wednesday Daily Thread: Beginner questions

# Weekly Thread: Beginner Questions 🐍

Welcome to our Beginner Questions thread! Whether you're new to Python or just looking to clarify some basics, this is the thread for you.

## How it Works:

1. Ask Anything: Feel free to ask any Python-related question. There are no bad questions here!
2. Community Support: Get answers and advice from the community.
3. Resource Sharing: Discover tutorials, articles, and beginner-friendly resources.

## Guidelines:

This thread is specifically for beginner questions. For more advanced queries, check out our [Advanced Questions Thread](#advanced-questions-thread-link).

## Recommended Resources:

If you don't receive a response, consider exploring r/LearnPython or join the Python Discord Server for quicker assistance.

## Example Questions:

1. What is the difference between a list and a tuple?
2. How do I read a CSV file in Python?
3. What are Python decorators and how do I use them?
4. How do I install a Python package using pip?
5. What is a virtual environment and why should I use one?

Let's help each other learn Python! 🌟

/r/Python
https://redd.it/1gkl9r8

A recommendation for a simple job queue, for LAN/electric outage resilient app?

I'm developing a Flask application to handle incoming data via webhooks. The primary goal is to ensure reliable processing and delivery of this data, even in the face of potential power outages or network interruptions.

To achieve this, I'm considering a queue-based system to store incoming data locally, preventing data loss if anything happens to my infrastructure.

I initially explored Celery and Redis, but I'm facing challenges in implementing simple, resilient tasks like sending a request and waiting for a response. This leads me to believe that these tools might be overkill for my specific use case.

Given my lack of experience with queue systems, I'm seeking guidance on the most suitable approach to meet my requirements. Are there any recommended best practices or alternative solutions that could be more efficient and straightforward?

/r/flask
https://redd.it/1gk9mo6

Just published an article to understand Python Project Management and Packaging, illustrated with uv

Hey everyone,



I’ve just finished writing the first part of my comprehensive guide on Python project management and packaging. Now that I think about it, I think it's more an article to understand the many concepts of Python packaging and project management more than a guide in and of itself.


The article: A Comprehensive Guide to Python Project Management and Packaging: Concepts Illustrated with uv – Part I



In this first part, I focused on:

\- The evolution of Python packaging standards through key PEPs.

\- Detailed explanations of the main concepts like `pyproject.toml`, the packaging nomenclature, the dependency groups, locking and syncing etc.

\- An introduction to `uv` and how it illustrates essential packaging concepts.

\- Practical workflows using `uv` that I use with data science projects.


Mainly what it lacks is a deeper section or paragraph on workspaces, scripts, building and publishing. That's for part 2!



Working on this article was mainly journey for me through the various PEPs that have shaped the current Python packaging standards. I delved into the history and rationale behind these PEPs. I just wanted to understand. I wanted to understand all the discussions around packaging. That's something we deal with daily, so I wanted to deeply understand

/r/Python
https://redd.it/1gkmrsg

Dendrite: Interact with websites with natural language instead of using css selectors

What my project does:

Dendrite is a simple framework for interacting with websites using natural language. Interact and extract without having to find brittle css selectors or xpaths like this:

browser.click(“the sign in button”)

For the developers who like their code typed, specify what data you want with a Pydantic BaseModel and Dendrite returns it in that format with one simple function call. Built on top of playwright for a robust experience. This is an easy way to give your AI agents the same web browsing capabilities as humans have. Integrates easily with frameworks such as  Langchain, CrewAI, Llamaindex and more. 

We are planning on open sourcing everything soon as well so feel free to reach out to us if you’re interested in contributing!

Github: https://github.com/dendrite-systems/dendrite-python-sdk

Overview

Authenticate Anywhere: Dendrite Vault, our Chrome extension, handles secure authentication, letting your agents log in to almost any website.
Interact Naturally: With natural language commands, agents can click, type, and navigate through web elements with ease.
Extract and Manipulate Data: Collect structured data from websites, return data from different websites in the same structure without having to maintain different scripts.
Download/Upload Files: Effortlessly manage file interactions to and from websites, equipping agents to handle documents,

/r/Python
https://redd.it/1gkg23q

Avoid Counting in Django Pagination
https://testdriven.io/blog/django-avoid-counting/

/r/django
https://redd.it/1gk8ubx

ParScrape v0.4.7 Released

# What My project Does:

Scrapes data from sites and uses AI to extract structured data from it.

# Whats New:

* BREAKING CHANGE: --pricing cli option now takes a string value of 'details', 'cost', or 'none'.
* Added pool of user agents that gets randomly pulled from.
* Updating pricing data.
* Pricing token capture and compute now much more accurate.
* Faster startup

# Key Features:

* Uses Playwright / Selenium to bypass most simple bot checks.
* Uses AI to extract data from a page and save it various formats such as CSV, XLSX, JSON, Markdown.
* Has rich console output to display data right in your terminal.

# GitHub and PyPI

* PAR Scrape is under active development and getting new features all the time.
* Check out the project on GitHub or for full documentation, installation instructions, and to contribute: [https://github.com/paulrobello/par\_scrape](https://github.com/paulrobello/par_scrape)
* PyPI [https://pypi.org/project/par\_scrape/](https://pypi.org/project/par_scrape/)

# Comparison:

I have seem many command line and web applications for scraping but none that are as simple, flexible and fast as ParScrape

# Target Audience

AI enthusiasts and data hungry hobbyist

/r/Python
https://redd.it/1gkhl3c