Python pipeline flow visual scripting, auto-convert functions to nodes for fast, tweakable demos

I’m making a Python pipeline flow orchestration tool, a ML visual nodes system. It can automatically discover your functions as pipeline nodes.  It can fast demo your python program for customers to tweak and expand. Visually pick input files, tune parameters, and preview any image input/output all in the friendly UI!

What My Project Does

Automatically discover python functions as nodes with parameters typing
Save/load pipeline as json and switch between pipelines quickly
Export the pipeline graph as Python code
Publish and install community node packages easily

GitHub: https://github.com/oozzy77/nozyio

Target Audience

Perfect for AI/ML engineers and designers to collaborate, turning ML components into UI nodes for easy tweaking. It's kinda like gradio but with modular and reusable interface blocks

Installation

In you python project, pip install nozyio then nozyio in your terminal and it will start the web UI.

Pypi: https://pypi.org/project/nozyio/

🎥video demo: https://www.youtube.com/watch?v=-bL3AcAufd8

I’m planning on porting some popular ML frameworks like huggingface’s transformers and diffusers into the node system so you can build AI generation pipelines visually. If you are interested in collaborating ✨, please do not hesitate to DM me!! Or email me at nozyio.hello@gmail.com

Comparison

This idea is inspired by ComfyUI but for more generic python scripting, not too much bounded with aigc models.

Thank you!

/r/Python
https://redd.it/1geuljm

R "How to train your VAE" substantially improves the reported results for standard VAE models (ICIP 2024)

https://preview.redd.it/b1dmh67uroxd1.png?width=1025&format=png&auto=webp&s=3d42a65e2c0a946aa307f01886aebedfc4b88b8e

The proposed method redefines the Evidence Lower Bound (ELBO) with a mixture of Gaussians for the posterior probability, introduces a regularization term to prevent variance collapse, and employs a PatchGAN discriminator to enhance texture realism. The main contribution in this work is an ELBO that reduces the collapse of the posterior towards the anterior (observed as the generation of very similar, blurry images)

https://arxiv.org/abs/2309.13160
https://github.com/marianorivera/How2TrainUrVAE

/r/MachineLearning
https://redd.it/1get08n

FastStream: a powerful and easy-to-use library for building services with event streams

**FastStream** (https://github.com/airtai/faststream) simplifies the process of writing producers and consumers for message queues, handling all the parsing, networking and documentation generation automatically. It is a new package based on the ideas and experiences gained from **FastKafka** and **Propan**. By joining our forces, we picked up the best from both packages and created a unified way to write services capable of processing streamed data regardless of the underlying protocol. We'll continue to maintain both packages, but new development will be in this project.

Making streaming microservices has never been easier. Designed with junior developers in mind, **FastStream** simplifies your work while keeping the door open for more advanced use cases. Here's a look at the core features that make **FastStream** a go-to framework for modern, data-centric microservices.

Multiple Brokers: FastStream provides a unified API to work across multiple message brokers ([Apache Kafka](https://kafka.apache.org/), [RabbitMQ](https://www.rabbitmq.com/), [NATS](https://nats.io/) and [Redis](https://redis.io/))
**Pydantic Validation**: Leverage **Pydantic's** validation capabilities to serialize and validate incoming messages
[Automatic Docs](https://faststream.airt.ai/latest/getting-started/asyncapi/export/): Stay ahead with automatic [AsyncAPI](https://www.asyncapi.com/) documentation
Intuitive: Full-typed editor support makes your development experience smooth, catching errors before they reach runtime
[Powerful Dependency Injection System](https://faststream.airt.ai/latest/getting-started/dependencies/): Manage your service dependencies efficiently with FastStream's built-in DI system
**Testable**: Supports in-memory tests, making your CI/CD

/r/Python
https://redd.it/1gewobs

form don't get image input

[screenshot error](https://preview.redd.it/zs5mkuckfpxd1.png?width=335&format=png&auto=webp&s=4d18a733335ce6721b806ee157fcfadf8d45a024)

i make item add logic with CreateView class for user foreignkey user relation but when i give image input it does take image input and show (this field is required). i already give image input, again showing same error. i already write MEDIA\_URL and other media settings

class ItemCreateView(CreateView):
model = Item
fields = ['name','desp','price','image']
template_name = 'add.html'
success_url = reverse_lazy('home')

def form_valid(self, form):
form.instance.user = self.request.user

return super().form_valid(form)

/r/django
https://redd.it/1gevx6d

Wednesday Daily Thread: Beginner questions

# Weekly Thread: Beginner Questions 🐍

Welcome to our Beginner Questions thread! Whether you're new to Python or just looking to clarify some basics, this is the thread for you.

## How it Works:

1. Ask Anything: Feel free to ask any Python-related question. There are no bad questions here!
2. Community Support: Get answers and advice from the community.
3. Resource Sharing: Discover tutorials, articles, and beginner-friendly resources.

## Guidelines:

This thread is specifically for beginner questions. For more advanced queries, check out our [Advanced Questions Thread](#advanced-questions-thread-link).

## Recommended Resources:

If you don't receive a response, consider exploring r/LearnPython or join the Python Discord Server for quicker assistance.

## Example Questions:

1. What is the difference between a list and a tuple?
2. How do I read a CSV file in Python?
3. What are Python decorators and how do I use them?
4. How do I install a Python package using pip?
5. What is a virtual environment and why should I use one?

Let's help each other learn Python! 🌟

/r/Python
https://redd.it/1gf9e74

Simple GUI directory contents extraction for chatbot submission

* **What My Project Does :**

A simple GUI tool that extracts a given directory structure and the contents of all its files then prints everything in an organized textbox + in an optional .txt file.

I made it to lazily submit entire projects to ChatGPT and let it "understand" their structure quickly.

* **Target Audience**

Anyone using chatgpt (or any llm chatbot) for writing or debugging code

* **Comparison**

There are probably better lightweight alternatives that I don't know about but this might be an easy to use alternative



Link to the project :

[https://github.com/SeidSmatti/iziSajra](https://github.com/SeidSmatti/iziSajra)

/r/Python
https://redd.it/1gey27a

PyBay 2024 conference talk videos are now online!

You can view all the PyBay 2024 (the San Francisco Bay Area Python conference) talks here: https://www.youtube.com/playlist?list=PL85KuAjbNgvx5bBgLVcKfccnlZAVPMk

As a reminder, https://pyvideo.org is a large index of Python-related conference talks from many regional PyCons.

/r/Python
https://redd.it/1gexoow

Is it worth it to take Coursera course?

Did someone take the course
Programming for Everybody (Getting Started with Python) by University of Michigan?
Or what sources would you recommend for someone who doesn't particularly like Python however understands it's necessary to learn it? There are also some courses on Udemy, but I personally like Coursera better

Thanks!


/r/Python
https://redd.it/1gfhfij

Let's use Pydantic, new kid on the block with Flask, shall we?
https://flask-india.hashnode.dev/using-flask-with-pydantic-new-bffs

/r/flask
https://redd.it/1gffi1w

Package for encrypting SQLite DB

Hi guys...... I working on a python + Qt application using sqlite database and would like to encrypt this database file

I've seen pysqlcipher and sqlcipher but all these I'm having issues installing the package its failing to buld even after installing c++ build tools and windows SDK still failing to build the package

any other module that works similar to sqlcipher that works well with peewee ORM as well

/r/Python
https://redd.it/1gfj3cg

Little issue with the flask app I have deployed on DigitalOcean


guys i am using flask Sqlalchemy and flask migrate in my flask app , I have deployed the app on digitalocean(i have made a repo on github and it accesses it from there) and in the console i do flask db init , migrate and update. But like if I make some changes in the code(on github) and upload it again(on digital ocean) then the data in the database of the previous version is lost

what should i do here



/r/flask
https://redd.it/1gfnrdu

D How do you structure your codebase and workflow for a new research project?

Suppose you have got a new idea about a solution to a problem in the domain you are working in. How do you go about implementing the thing from the ground up?

What is the general structure of the codebase you construct for your project?

How do you go about iteratively training and testing your solution until you arrive at a final solution where you can write a paper for publication?


Is there any design recipe you follow? Where did you learn it from?

/r/MachineLearning
https://redd.it/1gffm46

D Does anyone here work in healthcare?

I'm curious about the cool things people around the world are doing related to data in this area of work att

/r/MachineLearning
https://redd.it/1gfjngd

Deployed Django with Redis and Celery to AWS ECS using GithubAction

https://preview.redd.it/ty6v9fzurtxd1.png?width=1553&format=png&auto=webp&s=0e379df06d1d95edbcda627e40ac7b41913f8e5b

# ### AWS Deployment Steps

The deployment uses AWS ECS, Terraform, and GitHub Actions for CI/CD:

1. AWS Resources Setup:
An ECS Cluster is created using Terraform.
The Django, Celery worker, and Redis containers are deployed using ECS tasks.
A CloudWatch Log Group is configured to capture logs from the containers.
Network resources like VPC, subnets, security groups, and an Internet Gateway are created using Terraform.
2. GitHub Actions CI/CD:
The GitHub Actions workflow handles the build and deployment process.
Docker images are built and pushed to Amazon ECR.
Terraform manages the infrastructure as code for consistent deployments.
The public IP of the ECS service is retrieved and used to update Django's ALLOWED_HOSTS.

\-------------------------------------------------------------------------------------------

Set Up of All AWS Infra

the 4 files inside terrform working together

Redis and Django application are two separated container

And finally below is the digram for the entire deployement HLD, from github action to running as a Task in ECS

https://preview.redd.it/dkrn63wnvtxd1.png?width=2608&format=png&auto=webp&s=9ebb08d20448183a40d67ea230e4bb9689d45ccb

/r/django
https://redd.it/1gff0ly

Best gui for local client app?

I'm writing an application which is local. No server. I'm using python and I'm wanting to know people's opinions on the best gui to use.

So far I've used tkinter but it feels clunky and heavy, like it's from the early 2000s.

Can anyone recommend something better for modern looking stuff? Maybe I'm using tkinter wrong?

Any advice would be appreciated.

/r/Python
https://redd.it/1gfopgm

Improve TTFB

Hello,

I’m running into a response time issue with a Flask server in a test setup, and I’m hoping someone might have insights on how to tackle it. The server is set up to handle a pretty large data retrieval task—about 110MB, consisting of around 15,000 rows of complex JSON objects. Flask seems to handle the retrieval and processing reasonably well; it takes about 3 seconds to generate the JSON response. So far, so good.

The problem arises after the data is ready to be sent. I’m seeing a significant delay—around 6 additional seconds—between the endpoint finishing and the start of the response download. This delay feels unusually long, especially given the relatively quick processing time of the data retrieval itself. To troubleshoot, I measured the times directly in the endpoint method and looked at the Time to First Byte (TTFB) using Postman, which confirmed this lag.

I also tried enabling GZIP compression through Flask-Compress, hoping that reducing the response size might help speed things up. However, this didn’t have any effect; the response size stayed roughly the same, and the transmission time didn’t improve.

At this point, I’m not sure what else to try to minimize that 6-second delay. Does anyone have suggestions

/r/flask
https://redd.it/1gfu0fb

D I’m an ML/programming educator - I was invited as ceo of codesmith to Berlin Global Dialogue (tech/AI insider conference) - see what they said behind closed doors - AMA

Edit (5pm PT): Thanks so much all for really great questions - I'm going to pause now but will take a look over next 24 hours and try to answer any more questions. V grateful for chance to do this and to others who helped answer some of the Qs too from their perspective (shoutout u/Rebeleleven)

\--


I recently had the opportunity to attend the Berlin Global Dialogue, which has been likened to Davos but with a stronger focus on technology and AI . The lineup was impressive: Hermann Hauser, the founder of ARM, executives from OpenAI and ASML, and a mix of founders from emerging startups tackling everything from quantum ML to supply chain optimization. Even leaders like President Macron and the German Vice Chancellor were there, engaging with critical tech issues that impact us all.

As the CEO of Codesmith – a small, independent tech school with a data science and machine learning research group (last year we contributed to TensorFlow) – I was invited to announce our latest endeavor: Codesmith’s AI & ML Technical Leadership Program.

I shared this experience in an AMA on r/technology and had a great conversation—but the depth of questions around ML/AI didn’t quite match

/r/MachineLearning
https://redd.it/1gfv37y

D Monthly Who's Hiring and Who wants to be Hired?

For Job Postings please use this template

>Hiring: [Location\], Salary:[\], [Remote | Relocation\], [Full Time | Contract | Part Time\] and [Brief overview, what you're looking for\]

For Those looking for jobs please use this template

>Want to be Hired: [Location\], Salary Expectation:[\], [Remote | Relocation\], [Full Time | Contract | Part Time\] Resume: [Link to resume\] and [Brief overview, what you're looking for\]

​

Please remember that this community is geared towards those with experience.

/r/MachineLearning
https://redd.it/1gg4bau

Is anyone using Whitenoise with CloudFront in 2024?

So, I recently built a web app using just good old fullstack Django and I'm serving my assets locally with Whitenoise. When I moved to production, I configured CloudFront according to the Whitenoise docs (https://whitenoise.readthedocs.io/en/stable/django.html#use-a-content-delivery-network), but apparently these docs are very out of date (there's this issue from 2020 commenting on this https://github.com/evansd/whitenoise/issues/264) and I have been facing some weird bugs. All assets served by cloudfront are just 301 redirects, so each asset file is being served twice, apparently. Not only that, there's also a weird CORS error with a font I'm serving locally, without any other external CDNs.

Has anyone had any success using cloudfront to serve assets together with whitenoise? Does this setup even make sense anymore now that cloudfront is able to compress with both gzip and brotli?

/r/django
https://redd.it/1gg2wv8

Django clean urls.py
https://kodare.net/2024/10/31/django-clean-urls.html

/r/django
https://redd.it/1gg8gsr