pplx-api is coming out of beta and moving to usage based pricing, along with the first-ever live LLM APIs that are grounded with web search data and have no knowledge cutoff.
The "online" models: pplx-7b-online and pplx-70b-online have been trained in-house, building on top of Mistral and Llama 2, and fine-tuned to be accurate and helpful. Human evals suggest pplx surpass GPT-3.5 and Llama 2 on the task of answering questions with search grounding.
The search grounding also builds on top of the fine-tuned (and more helpful and accurate) versions of Llama and Mistral that we've trained in-house, pplx-chat-7b and pplx-chat-70b! pplx-api and labs.perplexity.ai exposes all these models in the form of APIs and a playground!
The "online" models: pplx-7b-online and pplx-70b-online have been trained in-house, building on top of Mistral and Llama 2, and fine-tuned to be accurate and helpful. Human evals suggest pplx surpass GPT-3.5 and Llama 2 on the task of answering questions with search grounding.
The search grounding also builds on top of the fine-tuned (and more helpful and accurate) versions of Llama and Mistral that we've trained in-house, pplx-chat-7b and pplx-chat-70b! pplx-api and labs.perplexity.ai exposes all these models in the form of APIs and a playground!
A-Lab has revolutionized inorganic materials discovery
Combining ab-initio calculations, historical data from literature, and robotic testing, they're rapidly uncovering new compounds.
Combining ab-initio calculations, historical data from literature, and robotic testing, they're rapidly uncovering new compounds.
Nature
An autonomous laboratory for the accelerated synthesis of novel materials
Nature - An autonomous laboratory, the A-Lab, is presented that combines computations, literature data, machine learning and active learning, which discovered and synthesized 41 novel compounds...
What are the biggest AI products on Discord, and how big are they in the scope of the platform?
The top ten AI apps by invite page traffic.
What are consumers doing in these Discords? Almost 100% asset gen!
Of the top 10, four are for image gen, three for voice/song gen, and two for video gen.
By traffic, image gen also takes the at 74% of top 10 traffic, followed by video gen at 8% and voice/music gen at 6%.
The top ten AI apps by invite page traffic.
What are consumers doing in these Discords? Almost 100% asset gen!
Of the top 10, four are for image gen, three for voice/song gen, and two for video gen.
By traffic, image gen also takes the at 74% of top 10 traffic, followed by video gen at 8% and voice/music gen at 6%.
If you're excited to help Biotech using AI, keep this chart in mind - the best way to improve cost+time per drug is to reduce risk of trial failure, not to use AI to make a bunch of new molecules.
Alibaba cloud introduced Qwen-72B and Qwen-1.8B. Including Base, Chat and Quantized versions. Open source of course.
Qwen-72B has been trained on high-quality data consisting of 3T tokens, boasting a larger parameter scale and more training data to achieve a comprehensive performance upgrade. Additionally, researchers have expanded the context window length to 32K and enhanced the system prompt capability, allowing users to customize their own AI assistant with just a single prompt.
Qwen-1.8B striking a balance between maintaining essential functionalities and maximizing efficiency, generating 2K-length text content with just 3GB of GPU memory.
Huggingface here.
Paper here.
Qwen-72B has been trained on high-quality data consisting of 3T tokens, boasting a larger parameter scale and more training data to achieve a comprehensive performance upgrade. Additionally, researchers have expanded the context window length to 32K and enhanced the system prompt capability, allowing users to customize their own AI assistant with just a single prompt.
Qwen-1.8B striking a balance between maintaining essential functionalities and maximizing efficiency, generating 2K-length text content with just 3GB of GPU memory.
Huggingface here.
Paper here.
GitHub
GitHub - QwenLM/Qwen: The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud. - QwenLM/Qwen
Wearable biosensor measures fertility hormones in sweat
Researchers have designed a wearable, ring-like biosensor for monitoring the hormone oestradiol in human sweat.
The technology is a fast-acting, non-invasive advance over conventional methods for tracking fertility and women’s health.
Whereas most biosensors use antibodies or enzymes to target proteins, Gao’s relies on aptamers — short bits of single-stranded DNA or RNA that are designed to fold such that they bind to targets ranging from small molecules to toxins. Although sometimes referred to as chemical antibodies, aptamers are much smaller than most antibodies and can be synthesized chemically, rather than in laboratory animals.
Researchers have previously designed aptamers to recognize cortisol, serotonin, caffeine and even some types of cancer.
To make the oestradiol sensor, the researchers designed two layers of material to work in tandem — an interface seeded with oestradiol-recognizing aptamers, and a gold-nanoparticle electrode covered in a material called MXene, which further enhances weak electrical signals. The aptamers are preloaded with single-stranded DNA that has been tagged with methylene blue, a dye that in this cases serves as an electrochemical probe.
Researchers have designed a wearable, ring-like biosensor for monitoring the hormone oestradiol in human sweat.
The technology is a fast-acting, non-invasive advance over conventional methods for tracking fertility and women’s health.
Whereas most biosensors use antibodies or enzymes to target proteins, Gao’s relies on aptamers — short bits of single-stranded DNA or RNA that are designed to fold such that they bind to targets ranging from small molecules to toxins. Although sometimes referred to as chemical antibodies, aptamers are much smaller than most antibodies and can be synthesized chemically, rather than in laboratory animals.
Researchers have previously designed aptamers to recognize cortisol, serotonin, caffeine and even some types of cancer.
To make the oestradiol sensor, the researchers designed two layers of material to work in tandem — an interface seeded with oestradiol-recognizing aptamers, and a gold-nanoparticle electrode covered in a material called MXene, which further enhances weak electrical signals. The aptamers are preloaded with single-stranded DNA that has been tagged with methylene blue, a dye that in this cases serves as an electrochemical probe.
Nature
Wearable biosensor measures fertility hormones in sweat
Nature - Ring-like device blends nanoelectronics and folded RNA to track hormone levels without the need for invasive blood tests.
❤3
#books This book will change how you look at biology. Truly outstanding treatment of the genetic and cellular world.
👍4
AI-generated human videos from pose detection is coming with Alibaba researcher's new 'Animate Anyone'.
GitHub
[Official Updates] Follow-up plans for the project · Issue #12 · HumanAIGC/AnimateAnyone
Thank you all for your incredible support and interest in our project. We've received lots of inquiries regarding a demo or the source code. We want to assure you that we are actively working o...
👍2
OpenBCI launches a neuro-powered spatial computer
Galea Beta device includes a range of sensors that simultaneously measure the user’s heart, skin, muscles, eyes, and brain.
Galea Beta includes eye-tracking and displays from Finnish headset-maker, Varjo and can be ordered with the Varjo Aero, XR-3 or the recently announced XR-4.
The Galea Beta sensors can be used without the HMD, or can be tethered to a high-powered PC and used for collecting data from VR and XR environments.
Long-term goal for Galea is to bring everything you see on the table, together into one device. Optics, CPU, I/O and sensors, in one tightly synchronized integrated system.
Galea Beta device includes a range of sensors that simultaneously measure the user’s heart, skin, muscles, eyes, and brain.
Galea Beta includes eye-tracking and displays from Finnish headset-maker, Varjo and can be ordered with the Varjo Aero, XR-3 or the recently announced XR-4.
The Galea Beta sensors can be used without the HMD, or can be tethered to a high-powered PC and used for collecting data from VR and XR environments.
Long-term goal for Galea is to bring everything you see on the table, together into one device. Optics, CPU, I/O and sensors, in one tightly synchronized integrated system.
OpenBCI Community
OpenBCI unveils vision for wearable, neuro-powered personal computer at Slush 2023
OpenBCI unveils vision for wearable, neuro-powered personal computer at Slush 2023. Latest Galea Beta device was revealed for the first time on-stage, along with OpenBCI’s future vision for "Galea Unlimited" wearable computer.
👍3
According to a Chinese computer scientist who asked not to be named, the new Sunway is not the most powerful supercomputer in China at present.
But after details of it were given at the Supercomputing 2023 (SC23) conference in Denver, US, earlier this month, it gave the public some hints on how China has managed to sidestep US sanctions to build its own supercomputers.
This Chinese dark horse has also outdone leading supercomputers, including the Frontier, in computing efficiency.
It can maintain over 85 per cent of its peak performance in regular operation, ranking the highest among all heterogeneous systems – a type of common supercomputing architecture – and second among all systems.
Meanwhile, China’s most powerful supercomputer remains undisclosed and other supercomputing chips are also under development, according to the Chinese scientist who works at a top mainland university.
But after details of it were given at the Supercomputing 2023 (SC23) conference in Denver, US, earlier this month, it gave the public some hints on how China has managed to sidestep US sanctions to build its own supercomputers.
This Chinese dark horse has also outdone leading supercomputers, including the Frontier, in computing efficiency.
It can maintain over 85 per cent of its peak performance in regular operation, ranking the highest among all heterogeneous systems – a type of common supercomputing architecture – and second among all systems.
Meanwhile, China’s most powerful supercomputer remains undisclosed and other supercomputing chips are also under development, according to the Chinese scientist who works at a top mainland university.
South China Morning Post
New Sunway supercomputer hints at how China sidestepped US sanctions
Chip war between US and China fails to stop scientists building one of the top supercomputers in the world.
A very important sleep study came out
Sleep has a huge impact on someone's health and even health span, but now it seems that "sleep regularity is an important predictor of mortality risk and is a stronger predictor than sleep duration."
Thus sleep regularity should be a simple, yet effective target for improving general health and survival.
Sleep has a huge impact on someone's health and even health span, but now it seems that "sleep regularity is an important predictor of mortality risk and is a stronger predictor than sleep duration."
Thus sleep regularity should be a simple, yet effective target for improving general health and survival.
OUP Academic
Sleep regularity is a stronger predictor of mortality risk than sleep duration: A prospective cohort study
Abstract. Abnormally short and long sleep are associated with premature mortality, and achieving optimal sleep duration has been the focus of sleep health guide
⚡4
Google has quietly delayed the public debut of Gemini to January
Sundar Pichai recently decided to scrap a series of Gemini events, originally scheduled this week after the company found the AI didn’t reliably handle some non-English queries.
It’s rare for Google to launch a major product between Thanksgiving and the end of the year, but Google intended to make an exception for Gemini because it’s arguably the company’s most important initiative in a decade.
The Gemini event in Washington was intended to showcase the technology to policymakers and politicians, which have increasingly discussed potential regulations involving AI.
Sundar Pichai recently decided to scrap a series of Gemini events, originally scheduled this week after the company found the AI didn’t reliably handle some non-English queries.
It’s rare for Google to launch a major product between Thanksgiving and the end of the year, but Google intended to make an exception for Gemini because it’s arguably the company’s most important initiative in a decade.
The Gemini event in Washington was intended to showcase the technology to policymakers and politicians, which have increasingly discussed potential regulations involving AI.
The Information
Google Preps Public Preview of Gemini AI After Postponing In-Person Launch Events
Update, Dec.4: After Google quietly scrapped a set of in-person events to launch Gemini, its biggest artificial intelligence initiative in a decade, the company has planned a virtual preview of the new AI as soon as this week, said a person with knowledge…
❤1
No GPU but wanna create your own LLM on laptop?
Here is a QLoRA on CPU, making LLM fine-tuning on client CPU possible.
Code.
Here is a QLoRA on CPU, making LLM fine-tuning on client CPU possible.
Code.
Medium
Creating Large Language Models on Your Laptop
Making Fine-Tuning Possible on Your Personal Computer
Taiwan's National Science and Technology Council has published a list of key technologies that are significant to Taiwan's national security: semiconductor manufacturing process technology under 14 nm included.
Can computers simulate brains?
Scientists have been exploring the intersection of math, computers, and neuroscience for decades. Today, machine learning is unlocking new possibilities in brain modeling.
Fascinating Nature paper on the latest in the field.
Scientists have been exploring the intersection of math, computers, and neuroscience for decades. Today, machine learning is unlocking new possibilities in brain modeling.
Fascinating Nature paper on the latest in the field.
Nature
How AI could lead to a better understanding of the brain
Nature - Early machine-learning systems were inspired by neural networks — now AI might allow neuroscientists to get to grips with the brain’s unique complexities.
👍4
How to Think of R&D - new report by a16Z on the cost item that is hardest to measure and track, but most important for tech companies.
1. R&D is the lifeblood of tech companies, but it’s the hardest to measure, and takes the longest to see paybacks and measure effectiveness.
2. So, how to allocate, plan, and measure R&D spend? First, start with benchmarks.
3. Then, map R&D spend to your product roadmap with expected returns/timelines. 70-20-10 is a common framework. It should be an output of the prioritization work you do, not a prescription. In platform shifts especially, like we have w/ AI now, 70-20-10 probably isn’t right.
4. Here’s another framework to consider rationale for spend and expected timing - offensive/defensive and short/long time.
5. Last, performance management is key.
6. Applying a framework and rigor to ROI is as critical for R&D as other areas of spend. The path and math are not as straightforward, but getting this right is critical.
1. R&D is the lifeblood of tech companies, but it’s the hardest to measure, and takes the longest to see paybacks and measure effectiveness.
2. So, how to allocate, plan, and measure R&D spend? First, start with benchmarks.
3. Then, map R&D spend to your product roadmap with expected returns/timelines. 70-20-10 is a common framework. It should be an output of the prioritization work you do, not a prescription. In platform shifts especially, like we have w/ AI now, 70-20-10 probably isn’t right.
4. Here’s another framework to consider rationale for spend and expected timing - offensive/defensive and short/long time.
5. Last, performance management is key.
6. Applying a framework and rigor to ROI is as critical for R&D as other areas of spend. The path and math are not as straightforward, but getting this right is critical.
👍2
Apple released new software from machine learning research.
MLX is an efficient machine learning framework specifically designed for Apple silicon (i.e. your laptop!)
Code.
This may be Apple's biggest move on open-source AI so far: MLX, a PyTorch-style NN framework optimized for Apple Silicon, e.g. laptops with M-series chips.
The release did an excellent job on designing an API familiar to the deep learning audience, and showing minimalistic examples on OSS models that most people care about: Llama, LoRA, Stable Diffusion, and Whisper.
MLX is an efficient machine learning framework specifically designed for Apple silicon (i.e. your laptop!)
Code.
This may be Apple's biggest move on open-source AI so far: MLX, a PyTorch-style NN framework optimized for Apple Silicon, e.g. laptops with M-series chips.
The release did an excellent job on designing an API familiar to the deep learning audience, and showing minimalistic examples on OSS models that most people care about: Llama, LoRA, Stable Diffusion, and Whisper.
GitHub
GitHub - ml-explore/mlx: MLX: An array framework for Apple silicon
MLX: An array framework for Apple silicon. Contribute to ml-explore/mlx development by creating an account on GitHub.
🔥1