How I hacked together GPT4 and government data
# What My Project Does?
I built an AI system that uses only official USA government sources with GPT4 to help us navigate the bureaucracy.
The result is pretty cool, you can play around at https://app.clerkly.co/ .
# Target Audience
The target audience is everyone who has problems with dealing with USA government bureaucracy.
# Comparison
Google: I use only official government sources for answering your queries
ChatGPT: I use a combination of agents and only government sources to provide answers with high-quality quotable sources .
# How Did I Achieve This?
1. Locating Data
First, it's important to gather all the essential government data you need. This can involve a lot of time browsing various federal and local government websites. Your goal is to find the domains that hold the relevant information. Be patient and thorough during this phase because the quality of your data depends on it.
2. Scraping Data
To collect data from these sites, I used Apify (https://apify.com/). This platform allows you to set up web crawlers which can automatically extract data from web pages. However, setting up these crawlers can be tricky:
You'll have to make sure to exclude irrelevant pages like random address books or archives.
No single format works for all websites, so you'll need
/r/Python
https://redd.it/1exp952
# What My Project Does?
I built an AI system that uses only official USA government sources with GPT4 to help us navigate the bureaucracy.
The result is pretty cool, you can play around at https://app.clerkly.co/ .
# Target Audience
The target audience is everyone who has problems with dealing with USA government bureaucracy.
# Comparison
Google: I use only official government sources for answering your queries
ChatGPT: I use a combination of agents and only government sources to provide answers with high-quality quotable sources .
# How Did I Achieve This?
1. Locating Data
First, it's important to gather all the essential government data you need. This can involve a lot of time browsing various federal and local government websites. Your goal is to find the domains that hold the relevant information. Be patient and thorough during this phase because the quality of your data depends on it.
2. Scraping Data
To collect data from these sites, I used Apify (https://apify.com/). This platform allows you to set up web crawlers which can automatically extract data from web pages. However, setting up these crawlers can be tricky:
You'll have to make sure to exclude irrelevant pages like random address books or archives.
No single format works for all websites, so you'll need
/r/Python
https://redd.it/1exp952
Apify
Apify: Full-stack web scraping and data extraction platform
Cloud platform for web scraping, browser automation, AI agents, and data for AI. Use 10,000+ ready-made tools, code templates, or order a custom solution.
Flask Mongo CRUD Package
I created a Flask package that generates CRUD endpoints automatically from defined mongodb models. This approach was conceived to streamline the laborious and repetitive process of developing CRUD logic for every entity in the application. You can find the package here: flask-mongo-crud · PyPI
Your feedback and suggestions are welcome :)
/r/flask
https://redd.it/1ey1isa
I created a Flask package that generates CRUD endpoints automatically from defined mongodb models. This approach was conceived to streamline the laborious and repetitive process of developing CRUD logic for every entity in the application. You can find the package here: flask-mongo-crud · PyPI
Your feedback and suggestions are welcome :)
/r/flask
https://redd.it/1ey1isa
PyPI
flask-mongo-crud
Automatically generates CRUD endpoints from defined models
Sauron Vision Project
* **What My Project Does**
Hi guys,
I was building a bot to play DayZ (it's not going well :\^)
So I thought I'd leave the first part of the code here. It's simple but efficient. My program takes a screenshot from a window name (Ex: Chrome.exe) gets the size of the window in real-time, saves the capture and uses CV2 to match to a templates' folder. Finally returns matches in a log and bounding boxes in the processed folder, obviously you could save that info however you want ;)
I've put two versions of the code, one in full for reading and the other with utils so you can extend. For example, before gray scaling, you could get exact colours at specific pixels for state representation. Or add contours processing, OCR, etc
[https://github.com/hadriloge/Sauron](https://github.com/hadriloge/Sauron)
* **Target Audience** (e.g., Is it meant for production, just a toy project, etc.
I guess people who like to automate things, probably looking at dynamic environments like games or video feeds, or just live usage.
* **Comparison** (A brief comparison explaining how it differs from existing alternatives.)
I know that Pyautogui has some features to automate directly based on images, but the idea here was to use PyWin32 and Psutil so that
/r/Python
https://redd.it/1eygt5i
* **What My Project Does**
Hi guys,
I was building a bot to play DayZ (it's not going well :\^)
So I thought I'd leave the first part of the code here. It's simple but efficient. My program takes a screenshot from a window name (Ex: Chrome.exe) gets the size of the window in real-time, saves the capture and uses CV2 to match to a templates' folder. Finally returns matches in a log and bounding boxes in the processed folder, obviously you could save that info however you want ;)
I've put two versions of the code, one in full for reading and the other with utils so you can extend. For example, before gray scaling, you could get exact colours at specific pixels for state representation. Or add contours processing, OCR, etc
[https://github.com/hadriloge/Sauron](https://github.com/hadriloge/Sauron)
* **Target Audience** (e.g., Is it meant for production, just a toy project, etc.
I guess people who like to automate things, probably looking at dynamic environments like games or video feeds, or just live usage.
* **Comparison** (A brief comparison explaining how it differs from existing alternatives.)
I know that Pyautogui has some features to automate directly based on images, but the idea here was to use PyWin32 and Psutil so that
/r/Python
https://redd.it/1eygt5i
GitHub
GitHub - hadriloge/Sauron
Contribute to hadriloge/Sauron development by creating an account on GitHub.
Django Full Course for Beginners
https://youtu.be/6whz7Ujfpw0?si=x8HZ9jr3zo0gBHrX
/r/django
https://redd.it/1eyks47
https://youtu.be/6whz7Ujfpw0?si=x8HZ9jr3zo0gBHrX
/r/django
https://redd.it/1eyks47
YouTube
Django Full Course for Beginners | Part 1
Django for Beginners | Dr. Charles Severance's Course (CC-BY)
Explore Django basics with Dr. Charles Severance (https://www.youtube.com/@ChuckSeverance). This course covers HTTP, Django models, forms, JavaScript, jQuery, AJAX, and more. Course resources…
Explore Django basics with Dr. Charles Severance (https://www.youtube.com/@ChuckSeverance). This course covers HTTP, Django models, forms, JavaScript, jQuery, AJAX, and more. Course resources…
Enhancing a CRM Project for Small Business Owners: Seeking Innovative Features and Ideas
I have an idea to build a Django-based CRM project for small business owners, where they can add clients and save their information. but this is simple thing, I'm looking for additional features and enhancements to make the project more robust and valuable. If you have any innovative ideas or suggestions, I’d love to hear them!
/r/django
https://redd.it/1eylla3
I have an idea to build a Django-based CRM project for small business owners, where they can add clients and save their information. but this is simple thing, I'm looking for additional features and enhancements to make the project more robust and valuable. If you have any innovative ideas or suggestions, I’d love to hear them!
/r/django
https://redd.it/1eylla3
Reddit
From the django community on Reddit
Explore this post and more from the django community
Need help with Import csv to database, Export to csv, and updating a table
I have a simply Flask app connected with postgres of a company data. I have everything linked and have search features as well as a couple table views. I want to add a section to import new csv into the database, export the database as a csv as well as a button to update a certain table (consists of inserts, select, truncate, and re insert). Would anyone be able to help me with this please.
/r/flask
https://redd.it/1eynpy2
I have a simply Flask app connected with postgres of a company data. I have everything linked and have search features as well as a couple table views. I want to add a section to import new csv into the database, export the database as a csv as well as a button to update a certain table (consists of inserts, select, truncate, and re insert). Would anyone be able to help me with this please.
/r/flask
https://redd.it/1eynpy2
Reddit
From the flask community on Reddit
Explore this post and more from the flask community
D What industry has the worst data?
Curious to hear - what industry do you think has the worst quality data for ML, consistently?
I'm not talking individual jobs that have no realistic and foreseeable ML applications like carpentry. I'm talking your larger industries, banking, pharma, telcos, tech (maybe a bit broad), agriculture, mining, etc, etc.
Who's the deepest in the sh**ter?
/r/MachineLearning
https://redd.it/1eyj7vq
Curious to hear - what industry do you think has the worst quality data for ML, consistently?
I'm not talking individual jobs that have no realistic and foreseeable ML applications like carpentry. I'm talking your larger industries, banking, pharma, telcos, tech (maybe a bit broad), agriculture, mining, etc, etc.
Who's the deepest in the sh**ter?
/r/MachineLearning
https://redd.it/1eyj7vq
Reddit
From the MachineLearning community on Reddit
Explore this post and more from the MachineLearning community
Master the python logging module
As a consultant I often find interesting topics that could warrent some knowledge sharing or educational content.
To satisfy my own hunger to share knowledge and be creative I've started to create videos with the purpose of free education for junior to medior devs.
My first video is about how the python logging module works and hopes to demystify some interesting behavior.
Hope you like it!
https://youtu.be/A3FkYRN9qog?si=89rAYSbpJQm0SfzP
/r/Python
https://redd.it/1eyn4n7
As a consultant I often find interesting topics that could warrent some knowledge sharing or educational content.
To satisfy my own hunger to share knowledge and be creative I've started to create videos with the purpose of free education for junior to medior devs.
My first video is about how the python logging module works and hopes to demystify some interesting behavior.
Hope you like it!
https://youtu.be/A3FkYRN9qog?si=89rAYSbpJQm0SfzP
/r/Python
https://redd.it/1eyn4n7
YouTube
Master the python logging module
This video gives insight into the python logging module. Master handers, filters, formatters, log hierarchy and log configuration.
A write-up is available at https://www.timnology.io/articles/python-logging
#python #code #tutorial #education
A write-up is available at https://www.timnology.io/articles/python-logging
#python #code #tutorial #education
deploying flask app
hey guys i made a small web app using flask. i want to buy a domain name and deploy it as a website so my friends can interact. what is a simple and easy to use hosting service? i'm talking upload and live since i'm not good with network knowledge. any suggestion will be greatly appreciated
/r/flask
https://redd.it/1eyqmvm
hey guys i made a small web app using flask. i want to buy a domain name and deploy it as a website so my friends can interact. what is a simple and easy to use hosting service? i'm talking upload and live since i'm not good with network knowledge. any suggestion will be greatly appreciated
/r/flask
https://redd.it/1eyqmvm
Reddit
From the flask community on Reddit
Explore this post and more from the flask community
Open-Source SocialStarter Project
Six months ago, I started working on SocialStarter, an open-source Django project aimed at creating a flexible template for building social networks. The project includes features like posts, likes, comments, user relationships, and django-allauth for authentication. Unfortunately, due to an increasingly demanding workload, I haven’t been able to continue its development.
However, I believe in the potential of this project and the value of open-source collaboration. If you're someone just starting out and looking for a project to contribute to and learn from, I encourage you to jump in. SocialStarter offers a solid foundation, and with the right contributions, it could evolve into something significant. That’s the beauty of open-source—together, we can take a small idea and grow it into something impactful. If you’re interested, feel free to explore the GitHub repo and contribute.
/r/django
https://redd.it/1eys5bl
Six months ago, I started working on SocialStarter, an open-source Django project aimed at creating a flexible template for building social networks. The project includes features like posts, likes, comments, user relationships, and django-allauth for authentication. Unfortunately, due to an increasingly demanding workload, I haven’t been able to continue its development.
However, I believe in the potential of this project and the value of open-source collaboration. If you're someone just starting out and looking for a project to contribute to and learn from, I encourage you to jump in. SocialStarter offers a solid foundation, and with the right contributions, it could evolve into something significant. That’s the beauty of open-source—together, we can take a small idea and grow it into something impactful. If you’re interested, feel free to explore the GitHub repo and contribute.
/r/django
https://redd.it/1eys5bl
GitHub
GitHub - eriktaveras/SocialStarter: SocialStarter is an open source project designed to serve as a template for the creation of…
SocialStarter is an open source project designed to serve as a template for the creation of social networks. - eriktaveras/SocialStarter
Friday Daily Thread: r/Python Meta and Free-Talk Fridays
# Weekly Thread: Meta Discussions and Free Talk Friday 🎙️
Welcome to Free Talk Friday on /r/Python! This is the place to discuss the r/Python community (meta discussions), Python news, projects, or anything else Python-related!
## How it Works:
1. Open Mic: Share your thoughts, questions, or anything you'd like related to Python or the community.
2. Community Pulse: Discuss what you feel is working well or what could be improved in the /r/python community.
3. News & Updates: Keep up-to-date with the latest in Python and share any news you find interesting.
## Guidelines:
All topics should be related to Python or the /r/python community.
Be respectful and follow Reddit's Code of Conduct.
## Example Topics:
1. New Python Release: What do you think about the new features in Python 3.11?
2. Community Events: Any Python meetups or webinars coming up?
3. Learning Resources: Found a great Python tutorial? Share it here!
4. Job Market: How has Python impacted your career?
5. Hot Takes: Got a controversial Python opinion? Let's hear it!
6. Community Ideas: Something you'd like to see us do? tell us.
Let's keep the conversation going. Happy discussing! 🌟
/r/Python
https://redd.it/1eyykga
# Weekly Thread: Meta Discussions and Free Talk Friday 🎙️
Welcome to Free Talk Friday on /r/Python! This is the place to discuss the r/Python community (meta discussions), Python news, projects, or anything else Python-related!
## How it Works:
1. Open Mic: Share your thoughts, questions, or anything you'd like related to Python or the community.
2. Community Pulse: Discuss what you feel is working well or what could be improved in the /r/python community.
3. News & Updates: Keep up-to-date with the latest in Python and share any news you find interesting.
## Guidelines:
All topics should be related to Python or the /r/python community.
Be respectful and follow Reddit's Code of Conduct.
## Example Topics:
1. New Python Release: What do you think about the new features in Python 3.11?
2. Community Events: Any Python meetups or webinars coming up?
3. Learning Resources: Found a great Python tutorial? Share it here!
4. Job Market: How has Python impacted your career?
5. Hot Takes: Got a controversial Python opinion? Let's hear it!
6. Community Ideas: Something you'd like to see us do? tell us.
Let's keep the conversation going. Happy discussing! 🌟
/r/Python
https://redd.it/1eyykga
Redditinc
Reddit Rules
Reddit Rules - Reddit
ipydatagrid is now part of Project Jupyter
https://blog.jupyter.org/ipydatagrid-is-now-part-of-project-jupyter-3b3dfb877664
/r/IPython
https://redd.it/1eyv93s
https://blog.jupyter.org/ipydatagrid-is-now-part-of-project-jupyter-3b3dfb877664
/r/IPython
https://redd.it/1eyv93s
Medium
ipydatagrid is now part of Project Jupyter
Today, we are proud to announce that the ipydatagrid open source project has been incorporated into Project Jupyter as part of the Jupyter…
New Django Library: Django Action Trigger
It's been a while since I’ve shared something, but I’m excited to announce the release of a new Python library: Django Action Triggers.
This project is inspired by an older one I built a few years ago (django-email-signals). Django Action Triggers is a library that allows you to trigger actions based on database changes in your Django application.
It supports webhook integration and can send messages to brokers such as Kafka and RabbitMQ. You can easily set up actions to be triggered by specific events, all configurable through the front end.
What My Project Does
It allows you to configure triggers where a trigger is essentially watching out for some kind of database change. This is done using signals (post_save, pre_save, etc).
Alongside these triggers, you can configure some kind of action to take place. For now, this only will allow you to hit a webhook, or send a message to a message broker (RabbitMQ and Kafka supported).
Target Audience
At the moment, this is a toy project to get me comfortable write code that's supposed to be extensible again. However, would be nice if this eventually reaches production.
Comparison
From what I've seen so far, at the moment there isn't anything comparable unless you consider setting everything up
/r/django
https://redd.it/1eyyvt9
It's been a while since I’ve shared something, but I’m excited to announce the release of a new Python library: Django Action Triggers.
This project is inspired by an older one I built a few years ago (django-email-signals). Django Action Triggers is a library that allows you to trigger actions based on database changes in your Django application.
It supports webhook integration and can send messages to brokers such as Kafka and RabbitMQ. You can easily set up actions to be triggered by specific events, all configurable through the front end.
What My Project Does
It allows you to configure triggers where a trigger is essentially watching out for some kind of database change. This is done using signals (post_save, pre_save, etc).
Alongside these triggers, you can configure some kind of action to take place. For now, this only will allow you to hit a webhook, or send a message to a message broker (RabbitMQ and Kafka supported).
Target Audience
At the moment, this is a toy project to get me comfortable write code that's supposed to be extensible again. However, would be nice if this eventually reaches production.
Comparison
From what I've seen so far, at the moment there isn't anything comparable unless you consider setting everything up
/r/django
https://redd.it/1eyyvt9
Reddit
From the django community on Reddit: New Django Library: Django Action Trigger
Explore this post and more from the django community
New Django Library: Django Action Triggers
It's been a while since I’ve shared something, but I’m excited to announce the release of a new Python library: Django Action Triggers.
This project is inspired by an older one I built a few years ago (django-email-signals). Django Action Triggers is a library that allows you to trigger actions based on database changes in your Django application.
It supports webhook integration and can send messages to brokers such as Kafka and RabbitMQ. You can easily set up actions to be triggered by specific events, all configurable through the front end.
What My Project Does
It allows you to configure triggers where a trigger is essentially watching out for some kind of database change. This is done using signals (post_save, pre_save, etc).
Alongside these triggers, you can configure some kind of action to take place. For now, this only will allow you to hit a webhook, or send a message to a message broker (RabbitMQ and Kafka supported).
Target Audience
At the moment, this is a toy project to get me comfortable write code that's supposed to be extensible again. However, would be nice if this eventually reaches production.
Comparison
From what I've seen so far, at the moment there isn't anything comparable unless you consider setting everything up
/r/Python
https://redd.it/1eyz2pp
It's been a while since I’ve shared something, but I’m excited to announce the release of a new Python library: Django Action Triggers.
This project is inspired by an older one I built a few years ago (django-email-signals). Django Action Triggers is a library that allows you to trigger actions based on database changes in your Django application.
It supports webhook integration and can send messages to brokers such as Kafka and RabbitMQ. You can easily set up actions to be triggered by specific events, all configurable through the front end.
What My Project Does
It allows you to configure triggers where a trigger is essentially watching out for some kind of database change. This is done using signals (post_save, pre_save, etc).
Alongside these triggers, you can configure some kind of action to take place. For now, this only will allow you to hit a webhook, or send a message to a message broker (RabbitMQ and Kafka supported).
Target Audience
At the moment, this is a toy project to get me comfortable write code that's supposed to be extensible again. However, would be nice if this eventually reaches production.
Comparison
From what I've seen so far, at the moment there isn't anything comparable unless you consider setting everything up
/r/Python
https://redd.it/1eyz2pp
Reddit
From the Python community on Reddit: New Django Library: Django Action Triggers
Explore this post and more from the Python community
Would a Django-Next.js-JWT Authentication Starter Kit be Useful?
I've been toying with the idea of putting together a Django-Next.js-JWT integration specifically designed for handling authentication. Here’s what I’m thinking: using Django Rest Framework (DRF) along with simple_jwt for the backend, complemented by a custom admin panel using Jazzmin. On the frontend, Next.js would be used purely for consuming this setup, focusing solely on authentication boilerplate.
However, I’m curious about your thoughts on this. Given the existence of NextAuth, I wonder if this effort might be redundant. Do you think there's still value in having a dedicated Django-Next.js-JWT starter kit for those who prefer a more tailored approach or need specific backend customization?
I'd love to hear what you think about this idea. Do you think it's worth the effort, or should I reconsider? Your thoughts would really help me out!
/r/django
https://redd.it/1ez5a82
I've been toying with the idea of putting together a Django-Next.js-JWT integration specifically designed for handling authentication. Here’s what I’m thinking: using Django Rest Framework (DRF) along with simple_jwt for the backend, complemented by a custom admin panel using Jazzmin. On the frontend, Next.js would be used purely for consuming this setup, focusing solely on authentication boilerplate.
However, I’m curious about your thoughts on this. Given the existence of NextAuth, I wonder if this effort might be redundant. Do you think there's still value in having a dedicated Django-Next.js-JWT starter kit for those who prefer a more tailored approach or need specific backend customization?
I'd love to hear what you think about this idea. Do you think it's worth the effort, or should I reconsider? Your thoughts would really help me out!
/r/django
https://redd.it/1ez5a82
Reddit
From the django community on Reddit
Explore this post and more from the django community
Example: Django + NextJS + JWT Authentication
https://github.com/kalvincalimag/django-nextjs-jwt-starter
/r/django
https://redd.it/1ez8v9l
https://github.com/kalvincalimag/django-nextjs-jwt-starter
/r/django
https://redd.it/1ez8v9l
GitHub
GitHub - kalvincalimag/django-nextjs-jwt-starter: An example setup integrating Django REST Framework, React/NextJS, and JWT Authentication…
An example setup integrating Django REST Framework, React/NextJS, and JWT Authentication for your development needs - kalvincalimag/django-nextjs-jwt-starter
opencv based ttf rendering
Hey if you were ever wondering how you can load custom fonts in opencv, you cant do that natively, but i i developed a project that helps you load custom fonts in opencv python.
What My Project Does
My project allows you to render ttf files inside opencv and place text in images
Target Audience
Anyone who is working with text and computer vision
Comparison
From what ive seen there arent many other projects out there that does this, but some of similar projects i have seen are:
- https://pypi.org/project/a-cv2-putTrueTypeText/ this project get the job done, but have really messy code and doesnt have any documentation.
Repo: https://github.com/ivanrj7j/Font
Documentation: https://github.com/ivanrj7j/Font/wiki
I am looking for feedback thank you!
/r/Python
https://redd.it/1ez8w02
Hey if you were ever wondering how you can load custom fonts in opencv, you cant do that natively, but i i developed a project that helps you load custom fonts in opencv python.
What My Project Does
My project allows you to render ttf files inside opencv and place text in images
Target Audience
Anyone who is working with text and computer vision
Comparison
From what ive seen there arent many other projects out there that does this, but some of similar projects i have seen are:
- https://pypi.org/project/a-cv2-putTrueTypeText/ this project get the job done, but have really messy code and doesnt have any documentation.
Repo: https://github.com/ivanrj7j/Font
Documentation: https://github.com/ivanrj7j/Font/wiki
I am looking for feedback thank you!
/r/Python
https://redd.it/1ez8w02
PyPI
a-cv2-putTrueTypeText
Like cv2.putText, but with TrueType Fonts (ttf)
Do Operating Systems Really Impact Web Development?
I've always used macOS throughout my web development journey, and I'm curious to know if the operating system you use has a significant impact on web development. Apart from personal preference, are there any major differences or benefits in using different operating systems like Windows or Linux for web development tasks?
Thanks!
/r/django
https://redd.it/1ezjhvn
I've always used macOS throughout my web development journey, and I'm curious to know if the operating system you use has a significant impact on web development. Apart from personal preference, are there any major differences or benefits in using different operating systems like Windows or Linux for web development tasks?
Thanks!
/r/django
https://redd.it/1ezjhvn
Reddit
From the django community on Reddit
Explore this post and more from the django community