Machine Learning
40K subscribers
3.6K photos
28 videos
47 files
620 links
Real Machine Learning โ€” simple, practical, and built on experience.
Learn step by step with clear explanations and working code.

Admin: @HusseinSheikho || @Hussein_Sheikho
Download Telegram
"Dive into Deep Learning" ๐Ÿ“˜๐Ÿค– is an open-source book that forms the mathematical foundation for large language models. ๐Ÿง ๐Ÿ“

It covers linear algebra, mathematical analysis, probability theory, optimization methods, backpropagation, attention mechanisms, and transformer architectures. ๐Ÿงฎ๐Ÿ“‰๐Ÿ”„

The book progressively moves from classical neural networks and convolutional neural networks to modern transformers and practical techniques used in large language models. ๐Ÿš€๐Ÿ”—๐Ÿง 

It contains over 1,000 pages ๐Ÿ“– and provides clear explanations, practical examples, and exercises. โœ…๐Ÿ“ Making it one of the most comprehensive free resources for understanding the mathematical structure of modern artificial intelligence systems and language models. ๐ŸŒ๐Ÿ”๐Ÿค–

arxiv.org/pdf/2106.11342 ๐Ÿ”—

#DeepLearning #AI #MachineLearning #NeuralNetworks #Transformers #OpenSource
โค4
๐Ÿš€ Master Binary Classification with Neural Networks! ๐Ÿง โœจ

Ever wondered how to build a neural network from scratch in Python using NumPy? ๐Ÿ๐Ÿ“Š

Binary classification is at the heart of many machine learning applications. ๐ŸŽฏ๐Ÿค–

Our super-detailed guide walks you through the entire process step by step. ๐Ÿ“๐Ÿ“š

๐Ÿ’ก Dive in and start building your own neural network today! ๐Ÿ—๐Ÿ”ฅ
https://tinztwinshub.com/data-science/a-beginners-guide-to-developing-an-artificial-neural-network-from-zero/

#MachineLearning #NeuralNetworks #Python #DataScience #AI #Tech
๐Ÿ‘4โค2
๐Ÿ”ฅ Awesome open-source project to learn more about Transformer Models! ๐Ÿค–โœจ

We found this interactive website that shows you visually how transformer models work. ๐ŸŒ๐Ÿ“Š

Transformer Explainer:
https://poloclub.github.io/transformer-explainer/

#TransformerModels #OpenSource #AI #MachineLearning #DataScience #Tech

โœจ Join Best TG Channels
https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel
https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค3๐Ÿ”ฅ3๐Ÿ‘2๐Ÿ’ฉ1
Found an easy way to learn math for ML: Mathematics for Machine Learning ๐ŸŽ“๐Ÿ“š

This is a curated collection on GitHub, including books, research papers, video lectures, and basic materials on math for studying and reviewing the mathematical foundations of machine learning. ๐Ÿ“–๐Ÿ“Š

It helps build a stronger knowledge base by bringing together trusted resources around topics that machine learning engineers constantly encounter: linear algebra, mathematical analysis, probability theory, statistics, information theory, matrix calculus, and deep learning mathematics. ๐Ÿงฎ๐Ÿค–

Free public repository on GitHub. ๐Ÿ’ปโœจ

https://github.com/dair-ai/Mathematics-for-ML

#MachineLearning #Mathematics #DataScience #Learning #GitHub #AI
โค6
๐Ÿ”– A huge open-source course on AI Engineering from scratch

In the repository, we've collected:
โ€” 435 lessons;
โ€” 320+ hours of content;
โ€” Python, TypeScript, and Rust;
โ€” AI agents, MCP servers, prompts, and AI skills.

Moreover, almost every lesson includes practical tasks, so this isn't just theory, but a full-fledged roadmap for AI Engineering. ๐Ÿš€

โ›“๏ธ Link to the repository
https://github.com/rohitg00/ai-engineering-from-scratch

#AI #MachineLearning #Python #Rust #OpenSource #Tech

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค6๐Ÿ‘1
Transformer implementations for vision, audio, and AI agents ๐Ÿค–๐Ÿ‘๏ธ๐ŸŽต

Repo: https://github.com/Nicolepcx/transformers-the-definitive-guide

#AI #MachineLearning #Vision #Audio #Agents #Tech

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค4๐Ÿ‘2
Data leakage is one of the main reasons why ML demos look impressive... and then fail in production. ๐Ÿ“‰

The model didn't become smarter.
It just happened to see the correct answers in advance.

In 4 minutes, you'll understand where data leaks hide. ๐Ÿ”

Let's break it down below: ๐Ÿ‘‡

1. Data Leakage ๐Ÿ•ณ๏ธ

Data leakage occurs when information that won't be available at the time of actual prediction is used during the model training process.

Because of this, metrics on the validation stage can look much better than the actual quality of the model on new, previously unseen data.

2. Model Evaluation โš–๏ธ

The test set isn't just "additional data".
It's a simulation of the future.

Only train the model on the information that would have been available to you at the time of prediction.
Evaluate it on examples that the model couldn't have influenced during training.

3. Direct Leakage ๐Ÿšจ

This is the most obvious type of leakage.

Examples:
- a field with information from the future;
- an ID that encodes the target variable;
- a variable that appears only after an event has occurred;
- duplicate records in both the training and test sets.

If a feature doesn't exist at the time of inference (prediction), then it's likely a source of data leakage.

4. Indirect Leakage ๐Ÿ•ต๏ธ

This is the type of leakage that most often traps teams.

You perform normalization, imputation, feature selection, outlier removal, or dimensionality reduction before splitting the data into a training and test set.

The model didn't directly see the data from the test set.
But your preprocessing pipeline already saw it.

5. Train/Test Split โœ‚๏ธ

Wrong:
fit the scaler on all data โ†’ split the data โ†’ evaluate

Right:
split the data โ†’ fit the scaler only on the training set โ†’ apply it to both the training and test sets

The same idea applies to imputers, encoders, feature selection, PCA, and any preprocessing step that is trained on the data.

6. Cross-Validation ๐Ÿ”„

Each fold is a mini-experiment with a training and test set.
Therefore, preprocessing should be performed within each fold.

If you prepared the entire dataset once and then ran cross-validation, each fold would already have had access to its held-out data.

7. Pipelines ๐Ÿ› ๏ธ

A pipeline isn't just a way to make the code cleaner.
It's also a defense against data leakage.

Combine preprocessing, feature selection, and the model into a single pipeline, and then pass this pipeline to cross-validation or hyperparameter search (grid search).

8. AI Engineering Version ๐Ÿค–

Data leaks also occur in RAG systems and when evaluating LLMs.

Leakage occurs when you tune chunks, prompts, re-rankers, thresholds, or examples on the same evaluation dataset that you later present as "held-out".

As a result, your benchmark turns into training data.

9. Leakage Checklist โœ…

Before trusting the obtained metric, ask yourself:

- Could this feature exist at the time of prediction?
- Was any transformation (transform) step trained (fit) on the test data?
- Did cross-validation include the entire pipeline?
- Were we tuning parameters on the final evaluation dataset?

If the answer is "yes", then the metric likely doesn't reflect the actual quality of the model.

#MachineLearning #DataScience #MLOps #DataLeakage #ArtificialIntelligence #TechTips

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค4๐Ÿ‘3
FREE MIT books on AI and Machine Learning: ๐Ÿ“š๐Ÿค–

1. Foundations of Machine Learning cs.nyu.edu/~mohri/mlbook/
2. Understanding Deep Learning udlbook.github.io/udlbook/
3. Introduction to Machine Learning Systems โฏ Vol 1: mlsysbook.ai/vol1/assets/do โฏ Vol 2: mlsysbook.ai/vol2/assets/do
4. Algorithms for ML algorithmsbook.com
5. Deep Learning deeplearningbook.org
6. Reinforcement Learning andrew.cmu.edu/course/10-703/
7. Distributional Reinforcement Learning direct.mit.edu/books/oa-monog
8. Multi Agent Reinforcement Learning marl-book.com
9. Agents in the Long Game of AI direct.mit.edu/books/oa-monog
10. Fairness and Machine Learning fairmlbook.org
11. Probabilistic Machine Learning
โฏ Part 1 : probml.github.io/pml-book/book1
โฏ Part 2 : probml.github.io/pml-book/book2

#MIT #AI #MachineLearning #DeepLearning #ReinforcementLearning #FreeBooks

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค6
Introduction to Deep RL and DQN

Link: https://www.dailydoseofds.com/rl-course-part-6/

๐Ÿค– #DeepRL #DQN #ReinforcementLearning #AI #MachineLearning #DataScience

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค6
Optimizing the model's performance through Prompt Tuning with the PEFT library.

โœจ Full-fledged fine-tuning of language models requires a huge amount of video memory and completely overwrites the network's weights. We will apply the Prompt Tuning method (retraining virtual token prompts), which freezes the main model and adjusts only a tiny matrix of virtual embeddings. This allows adapting AI to a narrow task using a regular user's graphics card and without the risk of destroying the neural network's basic knowledge.

๐Ÿ“ฆ First, we will install the necessary libraries for working with transformers and effective fine-tuning methods (PEFT).

pip install torch transformers peft

โœ… The packages have been successfully installed in the system and are ready for configuring lightweight training. We will create a basic Prompt Tuning configuration for training just twenty virtual tokens instead of billions of model parameters.

from peft import PromptTuningConfig, PromptTuningInit, get_peft_model
from transformers import AutoModelForCausalLM

peft_config = PromptTuningConfig(
task_type="CAUSAL_LM",
prompt_tuning_init=PromptTuningInit.TEXT,
num_virtual_tokens=20,
prompt_tuning_init_text="Classify the sentiment of this text:",
tokenizer_name_or_path="gpt2"
)

๐Ÿ”„ The configuration is initialized and links the text prompt to the trainable virtual embeddings. We will wrap the base model in a PEFT container to freeze the main weights and leave only the new tokens available for gradient descent.

base_model = AutoModelForCausalLM.from_pretrained("gpt2")
peft_model = get_peft_model(base_model, peft_config)
peft_model.print_trainable_parameters()

๐Ÿš€ The model is ready for training, and the percentage of active parameters will be displayed on the screen (usually less than 0.01%).

python3 -c "from peft import PromptTuningConfig; print('PEFT Setup: OK')"

๐Ÿ“ Expected output: PEFT Setup: OK

pip uninstall peft -y

๐Ÿ’ก Prompt Tuning โ€” an ideal choice when you need to train a model for many different customers or tasks simultaneously. Instead of gigabyte-sized copies of neural networks, you store only lightweight configuration files weighing a few kilobytes, dynamically substituting them at inference.

#PromptTuning #PEFT #AI #MachineLearning #DeepLearning #DataScience

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค4๐Ÿ”ฅ1
If you want to finally understand how neural networks actually learn, I recommend these notes from Stanford CS224N. ๐Ÿง 

"Computing Neural Network Gradients" explains the calculation of gradients and backpropagation without black-box formulas. ๐Ÿ“‰

Inside:
โ€ข Chain Rule
โ€ข Computational Graphs
โ€ข Vectorized derivatives
โ€ข Efficient gradient calculation
โ€ข Step-by-step examples with formula analysis

Many people use PyTorch or TensorFlow every day, but never understood what happens after calling .backward(). ๐Ÿ”ฅ

These notes just fill this gap. ๐Ÿ› ๏ธ

PDF:
https://web.stanford.edu/class/cs224n/readings/gradient-notes.pdf

#NeuralNetworks #DeepLearning #StanfordCS #Backpropagation #MachineLearning #AIResearch

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค2
Data Science Interview Questions.pdf
1.4 MB
Data Science Interview Questions

๐Ÿ’ก Here is your curated list for Data Science interviews!

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO

#DataScience #AI #MachineLearning #LLM #TechJobs #InterviewPrep
โค4
A new collection of free courses has been added:

๐Ÿ”— https://github.com/dair-ai/ML-Course-Notes

Those studying ML through dozens of random tabs and unclosed playlists may find this repository useful for organizing their learning. ๐Ÿ“š

Machine Learning Course Notes is an open collection of notes on machine learning, NLP, and AI, compiled around full-fledged courses, not just individual videos. ๐Ÿง 

What's inside:

โ€ข Courses from the Machine Learning Specialization, MIT 6.S191, CMU Neural Nets for NLP, CS224N, CS25, and others
โ€ข A table with lectures, descriptions, videos, notes, and authors
โ€ข Links to the original lectures and accompanying notes
โ€ข WIP markers for incomplete materials
โ€ข Instructions for contributors on adding and improving notes

The idea was appreciated. ๐Ÿ‘

Instead of another collection of hundreds of links, a course map has been created where one can systematically go through the material without getting lost after a week of studying. ๐Ÿ—บ๏ธ

#MachineLearning #AI #DataScience #TechCommunity #LearningResources #OpenSource

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค3
If you already have 200 open tabs with courses, articles, and GitHub repositories on ML, this repository might save the situation a bit. ๐Ÿ˜…

Awesome Machine Learning Resources is a huge collection of sub-collections on machine learning, deep learning, and AI. ๐Ÿค–

Instead of endless Google searches, everything is organized into categories:

โ€ข fundamentals of machine learning
โ€ข neural networks and modern architectures
โ€ข tasks and application areas
โ€ข datasets
โ€ข libraries and tools
โ€ข fairness and AI ethics
โ€ข production ML and MLOps

Each link has a short description, so you can quickly understand whether it's worth opening it or skipping it. ๐Ÿ“

I particularly liked that the authors mark abandoned collections with an icon if they haven't been updated in over a year. โš ๏ธ

https://github.com/ZhiningLiu1998/awesome-machine-learning-resources

#MachineLearning #DeepLearning #AI #MLOps #DataScience #TechResources

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค2
This media is not supported in your browser
VIEW IN TELEGRAM
Someone spent several months manually writing a 200-page guide on mathematics and the basics of machine learning. ๐Ÿ“˜

No marketing fluff or endless links between articles. Just an attempt to gather all the most important things in one place. ๐ŸŽฏ

Inside:

โ€ข neural networks: backpropagation, SGD, Adam, BatchNorm; โš™๏ธ
โ€ข classic ML: SVM, Gradient Boosting, K-Means, PCA; ๐Ÿ“Š
โ€ข hardware for AI: Tensor Cores, Systolic Arrays, CUDA; ๐Ÿ–ฅ๏ธ
โ€ข transformers: Multi-Head Attention, KV Cache, LoRA; ๐Ÿง 
โ€ข computer vision: ViT, CNN, MAE, IoU, NMS, VLM; ๐Ÿ‘๏ธ
โ€ข agent systems: ReAct, memory, orchestration, OpenClaw. ๐Ÿค–

The author describes it as the material he would have wanted to receive himself several years ago. ๐Ÿ•ฐ๏ธ

And yes, the entire guide is distributed free of charge. ๐Ÿ†“

https://www.arjunvirk.com/writing/ml-guide

#MachineLearning #AI #DeepLearning #DataScience #NeuralNetworks #Tech

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค3
๐Ÿ”– A large collection of AI projects for practice

We found a repository that will help you move from theory to real development of AI applications.

Inside are dozens of ready-made projects: AI analytics, RAG systems, OCR applications, code review agents, travel assistants, and much more.

โ›“๏ธ Link to GitHub: https://github.com/Sumanth077/Hands-On-AI-Engineering

#AI #MachineLearning #Python #DataScience #OpenSource #Tech

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค5
Multi-Label Text Classification with Scikit-LLM ๐Ÿ“

In this article, you will learn how to perform multi-label text classification using large language models and the scikit-LLM library, without the need for labeled training data or complex model training. ๐Ÿš€

Topics we will cover include:

What multi-label classification is and why it matters for nuanced text analysis. ๐Ÿ“Š
How to set up and configure scikit-LLM with a free, open-source LLM from Groq for zero-shot inference. โš™๏ธ
How to load a real-world dataset and run multi-label sentiment predictions using a familiar scikit-learn-style workflow. ๐Ÿ“ˆ

Read: https://machinelearningmastery.com/multi-label-text-classification-with-scikit-llm/ ๐Ÿ”—

#ScikitLLM #TextClassification #LLM #MachineLearning #ZeroShot #DataScience

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค2
10 GitHub repositories that are worth checking out for an AI engineer ๐Ÿค–

1. Hands-On AI Engineering ๐Ÿ› ๏ธ

A collection of AI applications and agent systems with practical use cases of LLM.

๐Ÿ‘‰ https://github.com/Sumanth077/Hands-On-AI-Engineering

2. Hands-On Large Language Models ๐Ÿ“˜

Full code from the book Hands-On Large Language Models: from basics to fine-tuning.

๐Ÿ‘‰ https://github.com/HandsOnLLM/Hands-On-Large-Language-Models

3. AI Agents for Beginners ๐ŸŽ“

A free course from Microsoft with 11 lessons on creating AI agents.

๐Ÿ‘‰ https://github.com/microsoft/ai-agents-for-beginners

4. GenAI Agents ๐Ÿค–

A large collection of tutorials and implementations of agent systems.

๐Ÿ‘‰ https://github.com/NirDiamant/GenAI_Agents

5. Made With ML ๐Ÿš€

About the development, deployment, and support of production-ready ML systems.

๐Ÿ‘‰ https://github.com/GokuMohandas/Made-With-ML

6. Learn Harness Engineering โš™๏ธ

A practical course on Harness Engineering for AI agents.

๐Ÿ‘‰ https://github.com/walkinglabs/learn-harness-engineering

7. AutoResearch ๐Ÿ”ฌ

Autonomous cycles of ML experiments from Andrej Karpathy.

๐Ÿ‘‰ https://github.com/karpathy/autoresearch

8. Designing Machine Learning Systems ๐Ÿ“š

Notes and materials from Chip Huyen's book.

๐Ÿ‘‰ https://github.com/chiphuyen/dmls-book

9. Awesome LLM Inference โšก

A collection of materials on LLM inference: Flash Attention, KV Cache, quantization, and more.

๐Ÿ‘‰ https://github.com/xlite-dev/Awesome-LLM-Inference

10. LLM Course ๐Ÿ—บ๏ธ

A practical course on LLM with a roadmap and Colab notebooks.

๐Ÿ‘‰ https://github.com/mlabonne/llm-course

#AI #MachineLearning #LLM #DataScience #Tech #GitHub

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค4
๐ŸŽ“ A Free AI Course for Beginners by Microsoft

For those just getting into artificial intelligence, Microsoft offers a free course.

It runs for 12 weeks and includes 24 lessons with theory, hands-on assignments, labs, and quizzes.

The curriculum covers neural networks and deep learning, computer vision, natural language processing, genetic algorithms, and AI ethics. For practice, it uses the two main ML frameworksโ€”TensorFlow and PyTorch.

Each lesson follows the same structure: first, reading material, then a Jupyter notebook with code, and for some topics, a lab. The course is in English but has been translated into dozens of languages.

โžก๏ธ All materials and links are on GitHub
https://github.com/microsoft/AI-For-Beginners/blob/main/translations/ru/README.md

What's your AI level right now?

โค๏ธ โ€” Advanced user
๐Ÿ”ฅ โ€” Almost zero

#AICourse #Microsoft #DeepLearning #TensorFlow #PyTorch #MachineLearning

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค1
๐Ÿค– Calculating the Self-Attention mechanism in pure PyTorch.

The Attention Mechanism allows transformer neural networks to determine the connection between words in a text and dynamically focus on the most important context. We will step by step implement the basic algorithm Scaled Dot-Product Attention, using classic matrices of queries (Query), keys (Key) and values (Value). This will help us to visually see how the attention weights are mathematically calculated and how the model matches the tokens with each other. ๐Ÿง โœจ

To start, we will install the PyTorch library for performing tensor calculations. ๐Ÿ› ๏ธ

pip install torch

The library has been successfully loaded and is ready for mathematical modeling of transformer layers. โœ…

We will generate random vectors Query, Key and Value to simulate the passage of tokens through linear projections. ๐ŸŽฒ

import torch
import torch.nn.functional as F

q = torch.randn(1, 3, 4) # (batch, seq_len, dim)
k = torch.randn(1, 3, 4)
v = torch.randn(1, 3, 4)

The tensors have been initialized and represent three hidden states for a sequence of three words. ๐Ÿ“

We will calculate the token similarity matrix through the scalar product and then scale it by the square root of the vector dimensions. ๐Ÿ”ข

scores = torch.bmm(q, k.transpose(1, 2)) / (q.shape[-1] ** 0.5)
attention_weights = F.softmax(scores, dim=-1)
output = torch.bmm(attention_weights, v)

The scalar product has been translated into probability weights, based on which the final contextual vector has been formed. ๐Ÿ”„

A control run of the output dimension calculation:

python3 -c "import torch; q, k = torch.randn(1, 3, 4), torch.randn(1, 3, 4); print('Attention OK') if torch.bmm(q, k.transpose(1, 2)).shape == (1, 3, 3) else print('Error')"

Expected output: Attention OK โœ…

The Self-Attention formula lies at the heart of all modern LLMs, allowing them to process long contexts in parallel, unlike old recurrent networks (RNNs). Understanding this base is critically important for working with transformers, optimizing architectures and configuring KV-cache mechanisms. ๐Ÿš€๐Ÿง 

#PyTorch #Transformer #DeepLearning #AI #MachineLearning #LLM

โœจ Join Best TG Channels https://xn--r1a.website/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
Please open Telegram to view this post
VIEW IN TELEGRAM
โค4