Flowfile - An open-source visual ETL tool, now with a Pydantic-based node designer.

Hey r/Python,

I built Flowfile, an open-source tool for creating data pipelines both visually and in code. Here's the latest feature: Custom Node Designer.

# What My Project Does

Flowfile creates bidirectional conversion between visual ETL workflows and Python code. You can build pipelines visually and export to Python, or write Python and visualize it. The Custom Node Designer lets you define new visual nodes using Python classes with Pydantic for settings and Polars for data processing.

# Target Audience

Production-ready tool for data engineers who work with ETL pipelines. Also useful for prototyping and teams that need both visual and code representations of their workflows.

# Comparison

* **Alteryx**: Proprietary, expensive. Flowfile is open-source.
* **Apache NiFi**: Java-based, requires infrastructure. Flowfile is pip-installable Python.
* **Prefect/Dagster**: Orchestration-focused. Flowfile focuses on visual pipeline building.

# Custom Node Example

import polars as pl
from flowfile_core.flowfile.node_designer import (
CustomNodeBase, NodeSettings, Section,
ColumnSelector, MultiSelect, Types
)

class TextCleanerSettings(NodeSettings):
cleaning_options: Section = Section(
title="Cleaning Options",


/r/Python
https://redd.it/1nff4dw

I built a from-scratch Python package for classic Numerical Methods (no NumPy/SciPy required!)

Hey everyone,

Over the past few months I’ve been building a Python package called numethods — a small but growing collection of classic numerical algorithms implemented 100% from scratch. No NumPy, no SciPy, just plain Python floats and list-of-lists.

The idea is to make algorithms transparent and educational, so you can actually see how LU decomposition, power iteration, or RK4 are implemented under the hood. This is especially useful for students, self-learners, or anyone who wants a deeper feel for how numerical methods work beyond calling library functions.

https://github.com/denizd1/numethods

# 🔧 What’s included so far

Linear system solvers: LU (with pivoting), Gauss–Jordan, Jacobi, Gauss–Seidel, Cholesky
Root-finding: Bisection, Fixed-Point Iteration, Secant, Newton’s method
Interpolation: Newton divided differences, Lagrange form
Quadrature (integration): Trapezoidal rule, Simpson’s rule, Gauss–Legendre (2- and 3-point)
Orthogonalization & least squares: Gram–Schmidt, Householder QR, LS solver
Eigenvalue methods: Power iteration, Inverse iteration, Rayleigh quotient iteration, QR iteration
SVD (via eigen-decomposition of ATAA\^T AATA)
ODE solvers: Euler, Heun, RK2, RK4, Backward Euler, Trapezoidal, Adams–Bashforth, Adams–Moulton, Predictor–Corrector, Adaptive RK45

# ✅ Why this might be useful

Great for teaching/learning numerical methods step by step.
Good reference for people writing their own solvers in C/Fortran/Julia.
Lightweight, no dependencies.
Consistent object-oriented API (.solve(), .integrate() etc).

# 🚀 What’s next

PDE solvers (heat, wave, Poisson with finite differences)
More optimization

/r/Python
https://redd.it/1nexoe8

Thanks r/Python community for reviewing my project Ducky all in one networking tool!

Thanks to this community I received some feedbacks about Ducky that I posted last week on here, I got 42 stars on github as well and some comments for Duckys enhancement. Im thankful for the people who viewed the post and went to see the source code huge thanks to you all.

What Ducky Does:

Ducky is a desktop application that consolidates the essential tools of a network engineer or security enthusiast into a single, easy-to-use interface. Instead of juggling separate applications for terminal connections, network scanning, and diagnostics, Ducky provides a unified workspace to streamline your workflow. Its core features include a tabbed terminal (SSH, Telnet, Serial), an SNMP-powered network topology mapper, a port scanner, and a suite of security utilities like a CVE lookup and hash calculator.

Target Audience:

Ducky is built for anyone who works with network hardware and infrastructure. This includes:

Network Engineers & Administrators: For daily tasks like configuring switches and routers, troubleshooting connectivity, and documenting network layouts.
Cybersecurity Professionals: For reconnaissance tasks like network discovery, port scanning, and vulnerability research.
Students & Hobbyists: For those learning networking (e.g., for CompTIA Network+ or CCNA), Ducky provides a free, hands-on tool to explore and interact with real or virtual network devices.


/r/Python
https://redd.it/1nfdhlu

Every Python Built-In Function Explained

Hi there, I just wanted to know more about Python and I had this crazy idea about knowing every built-in function from this language. Hope you learn sth new. Any feedback is welcomed. The source has the intention of sharing learning.

Here's the explanation

/r/Python
https://redd.it/1nfphsi

What Auth/Security do you prefer for api in django ?

Hi all, I have been working on a django app and came to a point where i need to make a decision.

Should i use ?
1. Django(SessionAuthentication)
- Here i was facing issue with CSRF (Is CSRF good to have or must have ?)
2. Django allauth with dj-rest-auth with token based auth or with JWT
Here if i used JWT then what is more secure
\- sending refresh token in response body
\- sending refresh token in headers(cookie)
I just want to make an informed decision by taking help from you experienced devs.

Please enlighten me.




/r/django
https://redd.it/1nfqoib

Django deployed on Render gets me forbidden error in post

So recently i deployed backend made on django on render and frontend made on react on vercel so locally it was working perfectly but when i deployed on homepage i was calling an api which was GET request and it also worked perfectly on deployed version as well but on POST request its giving me forbidden error when i looked into it further it was something like CSRF error like from react i have to POST it with CSRF added to it .. so for calling any api i made a file called apiClient.js which i call for every api request (A small API client file that i call that fetches data from the backend, attaches CSRF tokens to non-GET requests, retries on 403 by refreshing the token, and always returns JSON.) and in the code itself i tackle an issue like i was not getting the csrftoken itself , like if i print document.cookies it gave me null all time .. i am trying to solve these issue from past few days tried chatgpt, gemini, deepseek , not solved the error yet . Please help me to fix these error or even if someone tackled the same issue you

/r/djangolearning
https://redd.it/1nbd0ss

Django needs a REST story
https://forum.djangoproject.com/t/django-needs-a-rest-story/42814

/r/django
https://redd.it/1nfssaq

Built a simple, open-source test planner your team can start using today
https://kingyo-demo.pages.dev

/r/django
https://redd.it/1nfovqz

Seeking better opportunities - Advice needed!

Hi everyone,

I'm a Full-Stack developer from Spain with over 4 years of experience, mainly working with Django and Python. I'm currently the sole tech lead on a project, working remotely. While I love what I do, I feel a bit stuck due to the relatively low salaries in Spain and limited growth opportunities.

I'm looking for advice on how to transition to better opportunities abroad (ideally remote or in another country with a stronger tech scene). Has anyone made a similar move? What platforms, strategies, or skills would you recommend to stand out internationally? Any tips on navigating visas or finding remote roles with higher pay?

Thanks in advance for any advice!


/r/django
https://redd.it/1nfdx6j

Announcing iceoryx2 v0.7: Fast and Robust Inter-Process Communication (IPC) Library

Hello hello,

I am one of the maintainers of the open-source zero-copy middleware iceoryx2, and we’ve just released iceoryx2 v0.7 which comes with Python language bindings. That means you can now use fast zero-copy communication directly in Python. Here is the full release blog: [https://ekxide.io/blog/iceoryx2-0-7-release/](https://ekxide.io/blog/iceoryx2-0-7-release/)

With iceoryx2 you can communicate between different processes, send data with publish-subscribe, build more complex request-response streams, or orchestrate processes using the event messaging pattern with notifiers and listeners.

We’ve prepared a set of Python examples here: [https://github.com/eclipse-iceoryx/iceoryx2/tree/main/examples/python](https://github.com/eclipse-iceoryx/iceoryx2/tree/main/examples/python)

On top of that, we invested some time into writing a detailed getting started guide in the iceoryx2 book: [https://ekxide.github.io/iceoryx2-book/main/getting-started/quickstart.html](https://ekxide.github.io/iceoryx2-book/main/getting-started/quickstart.html)

And one more thing: iceoryx2 lets Python talk directly to C, C++ and Rust processes - without any serialization or binding overhead. Check out the cross-language publish-subscribe example to see it in action: [https://github.com/eclipse-iceoryx/iceoryx2/tree/main/examples](https://github.com/eclipse-iceoryx/iceoryx2/tree/main/examples)

So in short:

* **What My Project Does:** Zero-Copy Inter-Process Communication
* **Target Audience:** Developers building distributed systems, plugin-based applications, or safety-critical and certifiable systems
* **Comparision:** Provides a high-level, service-oriented abstraction over low-level shared memory system calls

/r/Python
https://redd.it/1nfvo8y

Help!!. How do I approach to write code for this?

I have product and product_img table relation(one-many),
if client sends the form containing datas of product and product_img in single request,
what approach should i use(or standard),

should i extract text and img separately and feed to serializer and save it ?
or should i use nested serializer?

/r/django
https://redd.it/1nfn641

MathFlow: an easy-to-use math library for python

Project Site: [https://github.com/cybergeek1943/MathFlow](https://github.com/cybergeek1943/MathFlow)

In the process of doing research for my paper [Combinatorial and Gaussian Foundations of Rational Nth Root Approximations](https://doi.org/10.48550/arXiv.2508.14095) (on arXiv), I created this library to address the pain points I felt when using only SymPy and SciPy separately. I wanted something lightweight, easy to use (exploratory), and something that would support numerical methods more easily. Hence, I created this lightweight wrapper that provides a hybrid symbolic-numerical interface to symbolic and numerical backends. It is backward compatible with Sympy. In short, this enables much faster analysis of symbolic math expressions by providing both numerical and traditional symbolic methods of analysis in the same interface. I have also added additional numerical methods that neither SymPy nor SciPy have (Pade approximations, numerical roots, etc.). The main goal for this project is to provide a tool that requires as little of a learning curve as possible and allows them to just focus on the math they are doing.

# Core features

* **🔒 Operative Closure**: Mathematical operations return new Expression objects by default
* **⚡ Mutability Control**: Choose between immutable (default) and mutable expressions for different workflows
* **🔗 Seamless Numerical Integration**: Every symbolic expression has a `.n` attribute providing numerical methods without manual lambdification (uses cached lambdified

/r/Python
https://redd.it/1nfyq8o

Interactive Relationship-Aware Vector Search for Jupyter

# 🧬 RudraDB-Opin: Interactive Relationship-Aware Vector Search for Jupyter

**Turn your notebook into an intelligent research assistant that discovers hidden connections.**

# Perfect for Interactive Research

Working in Jupyter? Tired of losing track of related papers, connected concepts, and follow-up ideas? RudraDB-Opin brings **relationship-aware search** directly to your interactive Python environment.

# Beyond Similarity Search

Traditional vector search in notebooks: "Find papers similar to this one"
**RudraDB-Opin**: "Find papers similar to this one + cited works + follow-up research + related methodologies + prerequisite concepts"

# 🎯 Built for Research Workflows

# Interactive Discovery

* **Multi-hop exploration** \- Start with one paper, discover research chains
* **Relationship visualization** \- See how your documents connect
* **Dynamic relationship building** \- Add connections as you discover them
* **Auto-dimension detection** \- Works with any embedding model instantly

# Research Organization Made Easy

* **Hierarchical relationships** \- Literature reviews → Key papers → Specific methods
* **Temporal connections** \- Research progression over time
* **Causal links** \- Problem → Methodology → Solution → Applications
* **Cross-references** \- Related work and citations
* **Thematic clustering** \- Group by research themes automatically

# 🔬 Research Use Cases

**Literature Review**: Start with key paper → Auto-discover entire research lineage
**Knowledge Base**: Build searchable repository of papers with intelligent connections
**Research Planning**: Map

/r/IPython
https://redd.it/1nfrf3p

SplitterMR: a modular library for splitting & parsing documents

Hey guys, I just released **SplitterMR**, a library I built because none of the existing tools quite did what I wanted for slicing up documents cleanly for LLMs / downstream processing.

If you often work with **mixed document types** (PDFs, Word, Excel, Markdown, images, etc.) and **need flexible, reliable splitting/parsing**, this might be useful.

This library supports **multiple input formats**, e.g., text, Markdown, PDF, Word / Excel / PowerPoint, HTML / XML, JSON / YAML, CSV / TSV, and even images.

Files can be read using **MarkItDown** or **Docling**, so this is perfect if you are using those frameworks with your current applications.

Logically, it supports **many different splitting strategies**: not only based on the number of characters but on tokens, schema keys, semantic similarity, and many other techniques. You can even develop your own splitter using the Base object, and it is the same for the Readers!

In addition, **you can process the graphical resources of your documents (e.g., photos) using VLMs** (OpenAI, Gemini, HuggingFace, etc.), so you can extract the text or caption them!

# What’s new / what’s good in the latest release

* Stable Version **1.0.0** is out.
* Supports **more input formats / more robust readers**.
* **Stable API** for the Reader abstractions so

/r/Python
https://redd.it/1ng2h8x

I built QRPorter — local Wi-Fi file transfer via QR (PC ↔ Mobile)

Hi everyone, I built **QRPorter**, a small open-source utility that moves files between desktop and mobile over your LAN/Wi-Fi using QR codes. No cloud, no mobile app, no accounts — just scan & transfer.

# What it does

* **PC → Mobile file transfer:** select a file on your desktop, generate a QR code, scan with your phone and download the file in the phone browser.
* **Mobile → PC file transfer:** scan the QR on the PC, open the link on your phone, upload a file from the phone and it’s saved on the PC.

# Target audience

* Developers, students, and office users who frequently move screenshots, small media or documents between phone ↔ PC.
* Privacy-conscious users who want transfers to stay on their LAN/Wi-Fi (no third-party servers).
* Anyone who wants a dead-simple cross-device transfer without installing mobile apps.

# Comparison

* **No extra mobile apps / accounts** — works via the phone’s browser and the desktop app.
* **Local-first** — traffic stays on your Wi-Fi/LAN (no cloud).
* **Cross-platform** — desktop UI + web interface works with modern mobile browsers (Windows / macOS / Linux / iOS / Android).

# Requirements & tested platforms

* **Python 3.12+** and `pip`.
* Tested on **Windows 11** and **Linux**; macOS should work.
*

/r/Python
https://redd.it/1nfupw4

Nominate a Djangonaut for the 2025 Malcolm Tredinnick Memorial Prize
https://www.djangoproject.com/weblog/2025/sep/13/nominate-a-djangonaut-for-the-2025-malcolm-prize/

/r/django
https://redd.it/1ng7qi3

Sunday Daily Thread: What's everyone working on this week?

# Weekly Thread: What's Everyone Working On This Week? 🛠️

Hello /r/Python! It's time to share what you've been working on! Whether it's a work-in-progress, a completed masterpiece, or just a rough idea, let us know what you're up to!

## How it Works:

1. Show & Tell: Share your current projects, completed works, or future ideas.
2. Discuss: Get feedback, find collaborators, or just chat about your project.
3. Inspire: Your project might inspire someone else, just as you might get inspired here.

## Guidelines:

Feel free to include as many details as you'd like. Code snippets, screenshots, and links are all welcome.
Whether it's your job, your hobby, or your passion project, all Python-related work is welcome here.

## Example Shares:

1. Machine Learning Model: Working on a ML model to predict stock prices. Just cracked a 90% accuracy rate!
2. Web Scraping: Built a script to scrape and analyze news articles. It's helped me understand media bias better.
3. Automation: Automated my home lighting with Python and Raspberry Pi. My life has never been easier!

Let's build and grow together! Share your journey and learn from others. Happy coding! 🌟

/r/Python
https://redd.it/1ngcnn7

midi-visualiser: A real-time MIDI player and visualiser.

Hi all, I recently revisited an old project I created to visualise MIDI music (using a piano roll) and after some tidying up and fixes I've now uploaded it to PyPI! The program allows single MIDI files or playlists of MIDI files to be loaded and visualised through a command-line tool.

It's fairly simple, using Pygame to display the visualiser window and provide playback control, but I'm pretty proud of how it looks and the audio-syncing logic (which uses Mido to interpret MIDI events). More details on how to use it are available in the project repository.

This is the first project I've used uv for, and I absolutely love it - check it out if you haven't already. Also, any suggestions/comments about the project would be greatly appreciated as I'm very new to uploading to PyPI!

To summarise;
- What My Project Does: Plays MIDI files and visualises them using a scrolling piano roll
- Target Audience: Mainly just a toy project, but could be used by anyone who wants a simple & quick way to view any MIDI file!
- Comparison: I can't find any alternatives that have this same functionality (at least not made in Python) - it obviously can't compete with mega fancy MIDI visualisers, but

/r/Python
https://redd.it/1ng9en6

Tea Tasting: t-testing library alternatives?

I dont feel this repo is Pythonic nor are their docs sufficient: https://e10v.me/tea-tasting-analysis-of-experiments/ (am i missing something or stupid?)

Looking for good alternatives - I havent found any

/r/Python
https://redd.it/1ng8qg0

Building My Django Portfolio - Offering to Build Real Projects (Free or Low-Cost)

I’m currently a Python/Django developer in the making, working through my BCA degree and building my career path toward backend development. I’ve done several projects (REST APIs, dashboards, hackathon apps), but I want to strengthen my portfolio with real-world projects that solve actual problems for people.

That’s why I’m offering to:

* Build small-to-medium Django projects **for free** (or at a very low cost if the scope is bigger).
* Handle the **full stack if needed** (Django backend + React/HTML/CSS frontend).
* Learn and implement **deployment/hosting** , and if you prefer, I can even manage hosting for you at a minimal fee.

✅ Why am I doing this?

* To gain **real client experience** beyond personal projects.
* To practice **hosting, deployment, and maintenance**.
* To create a **stronger portfolio** that helps me land Python/Django roles.

If you’ve been thinking: *“I’d like a small app for my idea / side project / workflow, but don’t have a developer yet”,* this could be a great match.

⚠️ Just to set expectations:

* I’m focusing on **Django-based apps** (CRUD systems, dashboards, APIs, authentication, etc.).
* I’ll provide clear timelines and revisions, but I won’t be able to support endless scope creep.
* All projects will be added to my portfolio/GitHub (unless you’d like it private).

If

/r/django
https://redd.it/1nghsxo

D which papers HAVEN'T stood the test of time?

As in title! Papers that were released to lots of fanfare but haven't stayed in the zeitgeist also apply.

Less so "didn't stand the test of time" but I'm thinking of KANs. Having said that, it could also be that I don't work in that area, so I don't see it and followup works. I might be totally off the mark here so feel free to say otherwise

/r/MachineLearning
https://redd.it/1ng6dsf