pyper-dev/pyper
Concurrent Python made simple
Language:Python
Total stars: 136
Stars trend:
15 Jan 2025
2am █▌ +12
3am ██▊ +22
4am ██▊ +22
5am ██▋ +21
6am ██▏ +17
#python
#asyncio, #concurrency, #data, #datacollection, #dataengineering, #datapipelines, #dataprocessing, #multiprocessing, #parallelcomputing, #python, #threading

feldera/feldera
The Feldera Incremental Computation Engine
Language:Rust
Total stars: 962
Stars trend:
16 Jan 2025
5pm ▊ +6
6pm █▍ +11
7pm █▉ +15
8pm ▉ +7
9pm ▍ +3
10pm ▊ +6
11pm ▍ +3
17 Jan 2025
12am ▍ +3
1am ▍ +3
2am ▉ +7
3am ▊ +6
4am ▉ +7
#rust
#dataanalytics, #datapipelines, #database, #incrementalcomputation, #incrementalviewmaintenance, #ivm, #materializedviews, #realtime, #rust, #sql, #streaming

pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Language:Python
Total stars: 12635
Stars trend:
25 Jan 2025
12am ▏ +1
1am ▎ +2
2am +0
3am +0
4am +0
5am ▏ +1
6am +0
7am █████ +40
8am ████▎ +34
#python
#batchprocessing, #dataanalytics, #datapipelines, #dataprocessing, #dataflow, #etl, #etlframework, #iotanalytics, #kafka, #machinelearningalgorithms, #pathway, #python, #realtime, #rust, #streamprocessing, #streaming, #timeseriesanalysis

yobix-ai/extractous
Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.
Language:Rust
Total stars: 777
Stars trend:
29 Jan 2025
10pm █▏ +9
11pm ▌ +4
30 Jan 2025
12am █▎ +10
1am ▋ +5
2am █▏ +9
3am ▊ +6
4am ▉ +7
5am █ +8
6am ▉ +7
7am █ +8
8am ▋ +5
9am █ +8
#rust
#datapipelines, #docx, #etl, #etlpipelines, #extraction, #llm, #machinelearning, #naturallanguageprocessing, #nlp, #ocr, #pdf, #pdfparser, #rag, #rust, #tika, #unstructured, #unstructureddata

fmind/mlops-python-package
Kickstart your MLOps initiative with a flexible, robust, and productive Python package.
Language:Jupyter Notebook
Total stars: 1036
Stars trend:
1 Feb 2025
9am ▎ +2
10am ▍ +3
11am ▎ +2
12pm ▍ +3
1pm █▌ +12
2pm █▎ +10
3pm █▍ +11
4pm █ +8
5pm █▎ +10
6pm ▋ +5
7pm ▊ +6
8pm ▌ +4
#jupyternotebook
#automation, #datapipelines, #datascience, #machinelearning, #mlflow, #mlops, #pandera, #pydantic, #python

infinyon/fluvio
Lean and mean distributed stream processing system written in rust and web assembly. Alternative to Kafka + Flink in one.
Language:Rust
Total stars: 4721
Stars trend:
24 Apr 2025
4pm ▌ +4
5pm ████████▎ +66
6pm █▋ +13
7pm ▎ +2
8pm ▏ +1
#rust
#cloudnative, #dataanalytics, #dataflow, #dataintegration, #datapipelines, #distributedsystems, #eventdrivenarchitecture, #realtime, #rust, #serverless, #stateful, #streamprocessing, #streamprocessingengine, #streaming, #streaminganalytics, #streamingdata, #streamingdatapipelines, #streamingdataprocessing, #webassembly

pathwaycom/pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
Language:Python
Total stars: 24782
Stars trend:
17 May 2025
12am ▏ +1
1am +0
2am +0
3am +0
4am +0
5am ▌ +4
6am ▎ +2
7am █▍ +11
8am █████▌ +44
9am ███▋ +29
10am ██▊ +22
#python
#batchprocessing, #dataanalytics, #datapipelines, #dataprocessing, #dataflow, #etl, #etlframework, #iotanalytics, #kafka, #machinelearningalgorithms, #pathway, #python, #realtime, #rust, #streamprocessing, #streaming, #timeseriesanalysis