Microsoft Chief Scientific Officer Eric Horvitz explains how new prompting strategies can enable generalist large language models like GPT-4 to achieve exceptional expertise in specific domains, like medicine, and outperform fine-tuned specialist models.
Microsoft Research
The power of prompting
Microsoft Chief Scientific Officer Eric Horvitz explains how new prompting strategies can enable generalist large language models like GPT-4 to achieve exceptional expertise in specific domains, such as medicine, and outperform fine-tuned specialist models.
🔥2
Amazon has announced Q, a new AI chatbot for businesses
The chatbot helps corporate users with tasks like summarizing reports or answering policy questions.
Q aims to attract users weary of consumer chatbots handling sensitive info.
Amazon AWS also announced a host of new partnerships with NVIDIA, including:
-NVIDIA BioNeMo — a generative AI platform for drug discovery is coming to AWS.
-AWS becomes the first cloud provider to deploy GH200 chips.
The chatbot helps corporate users with tasks like summarizing reports or answering policy questions.
Q aims to attract users weary of consumer chatbots handling sensitive info.
Amazon AWS also announced a host of new partnerships with NVIDIA, including:
-NVIDIA BioNeMo — a generative AI platform for drug discovery is coming to AWS.
-AWS becomes the first cloud provider to deploy GH200 chips.
Lately Epic announced that it would tap Microsoft to accelerate generative AI-powered tools to help clinicians save time while using their electronic medical record systems.
Now Sumit Rana, head of research and development, gave an interview about that. A few take-aways:
1. Physicians ask the patient at the beginning of the visit if they can record the visit to help with documentation, and most patients are okay with it.
2. And then once that conversation is done, a few moments later, the note gets updated with a draft of what was discussed, and then a physician can review that note, make changes similar to what they might do in a dictation workflow, and then they finalize their documentation.
3. One site reported average savings of five-and-a-half hours per week. Another one looked at time spent by doctors after clinical hours, and they saw a 76% reduction in that time spent after clinic hours.
4. The other big learning we had was that it's super important for the provider to be able to hover and see citations so they can see not only what the summary is, but what facts within the medical record were used to generate this summary.
Now Sumit Rana, head of research and development, gave an interview about that. A few take-aways:
1. Physicians ask the patient at the beginning of the visit if they can record the visit to help with documentation, and most patients are okay with it.
2. And then once that conversation is done, a few moments later, the note gets updated with a draft of what was discussed, and then a physician can review that note, make changes similar to what they might do in a dictation workflow, and then they finalize their documentation.
3. One site reported average savings of five-and-a-half hours per week. Another one looked at time spent by doctors after clinical hours, and they saw a 76% reduction in that time spent after clinic hours.
4. The other big learning we had was that it's super important for the provider to be able to hover and see citations so they can see not only what the summary is, but what facts within the medical record were used to generate this summary.
Healthcare IT News
How Epic is using AI to change the way EHRs work
Sumit Rana, head of research and development, discusses how the EHR giant’s system uses AI to generate progress notes, create draft responses to patient questions and assist with medical coding. And how AI sometimes can be more empathetic than a person.
👍2
Will_Generative_AI_deliver_a_generational_transformation_1701272867.pdf
4.6 MB
Generative AI is causing major shifts in business - UBS discusses the sectors most likely to be impacted by GenAI.
Here are key takeaways:
1. Generative AI could intensify competition across multiple sectors like software, media, commercial services, and semiconductors where employee costs are high.
2. But it also presents opportunities to boost revenues and reduce costs. Analysts see potential in areas like luxury, mining, real estate, retail, semis, tech hardware, and telecoms.
3. Retail specifically may benefit due to thin margins and a high proportion of automatable roles.
4. AI makes the entry barrier to starting a business far more easier, so we can predict to see many more startups competing with already-established businesses.
5. By 2025, generative AI may help discover 30% of new medicine and generate 30% of outbound marketing messages.
6. Implementation barriers persist around regulation, ethics, privacy, and result accuracy. Addressing those factors is key.
Here are key takeaways:
1. Generative AI could intensify competition across multiple sectors like software, media, commercial services, and semiconductors where employee costs are high.
2. But it also presents opportunities to boost revenues and reduce costs. Analysts see potential in areas like luxury, mining, real estate, retail, semis, tech hardware, and telecoms.
3. Retail specifically may benefit due to thin margins and a high proportion of automatable roles.
4. AI makes the entry barrier to starting a business far more easier, so we can predict to see many more startups competing with already-established businesses.
5. By 2025, generative AI may help discover 30% of new medicine and generate 30% of outbound marketing messages.
6. Implementation barriers persist around regulation, ethics, privacy, and result accuracy. Addressing those factors is key.
🆒2
pplx-api is coming out of beta and moving to usage based pricing, along with the first-ever live LLM APIs that are grounded with web search data and have no knowledge cutoff.
The "online" models: pplx-7b-online and pplx-70b-online have been trained in-house, building on top of Mistral and Llama 2, and fine-tuned to be accurate and helpful. Human evals suggest pplx surpass GPT-3.5 and Llama 2 on the task of answering questions with search grounding.
The search grounding also builds on top of the fine-tuned (and more helpful and accurate) versions of Llama and Mistral that we've trained in-house, pplx-chat-7b and pplx-chat-70b! pplx-api and labs.perplexity.ai exposes all these models in the form of APIs and a playground!
The "online" models: pplx-7b-online and pplx-70b-online have been trained in-house, building on top of Mistral and Llama 2, and fine-tuned to be accurate and helpful. Human evals suggest pplx surpass GPT-3.5 and Llama 2 on the task of answering questions with search grounding.
The search grounding also builds on top of the fine-tuned (and more helpful and accurate) versions of Llama and Mistral that we've trained in-house, pplx-chat-7b and pplx-chat-70b! pplx-api and labs.perplexity.ai exposes all these models in the form of APIs and a playground!
A-Lab has revolutionized inorganic materials discovery
Combining ab-initio calculations, historical data from literature, and robotic testing, they're rapidly uncovering new compounds.
Combining ab-initio calculations, historical data from literature, and robotic testing, they're rapidly uncovering new compounds.
Nature
An autonomous laboratory for the accelerated synthesis of novel materials
Nature - An autonomous laboratory, the A-Lab, is presented that combines computations, literature data, machine learning and active learning, which discovered and synthesized 41 novel compounds...
What are the biggest AI products on Discord, and how big are they in the scope of the platform?
The top ten AI apps by invite page traffic.
What are consumers doing in these Discords? Almost 100% asset gen!
Of the top 10, four are for image gen, three for voice/song gen, and two for video gen.
By traffic, image gen also takes the at 74% of top 10 traffic, followed by video gen at 8% and voice/music gen at 6%.
The top ten AI apps by invite page traffic.
What are consumers doing in these Discords? Almost 100% asset gen!
Of the top 10, four are for image gen, three for voice/song gen, and two for video gen.
By traffic, image gen also takes the at 74% of top 10 traffic, followed by video gen at 8% and voice/music gen at 6%.
If you're excited to help Biotech using AI, keep this chart in mind - the best way to improve cost+time per drug is to reduce risk of trial failure, not to use AI to make a bunch of new molecules.
Alibaba cloud introduced Qwen-72B and Qwen-1.8B. Including Base, Chat and Quantized versions. Open source of course.
Qwen-72B has been trained on high-quality data consisting of 3T tokens, boasting a larger parameter scale and more training data to achieve a comprehensive performance upgrade. Additionally, researchers have expanded the context window length to 32K and enhanced the system prompt capability, allowing users to customize their own AI assistant with just a single prompt.
Qwen-1.8B striking a balance between maintaining essential functionalities and maximizing efficiency, generating 2K-length text content with just 3GB of GPU memory.
Huggingface here.
Paper here.
Qwen-72B has been trained on high-quality data consisting of 3T tokens, boasting a larger parameter scale and more training data to achieve a comprehensive performance upgrade. Additionally, researchers have expanded the context window length to 32K and enhanced the system prompt capability, allowing users to customize their own AI assistant with just a single prompt.
Qwen-1.8B striking a balance between maintaining essential functionalities and maximizing efficiency, generating 2K-length text content with just 3GB of GPU memory.
Huggingface here.
Paper here.
GitHub
GitHub - QwenLM/Qwen: The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud. - QwenLM/Qwen
Wearable biosensor measures fertility hormones in sweat
Researchers have designed a wearable, ring-like biosensor for monitoring the hormone oestradiol in human sweat.
The technology is a fast-acting, non-invasive advance over conventional methods for tracking fertility and women’s health.
Whereas most biosensors use antibodies or enzymes to target proteins, Gao’s relies on aptamers — short bits of single-stranded DNA or RNA that are designed to fold such that they bind to targets ranging from small molecules to toxins. Although sometimes referred to as chemical antibodies, aptamers are much smaller than most antibodies and can be synthesized chemically, rather than in laboratory animals.
Researchers have previously designed aptamers to recognize cortisol, serotonin, caffeine and even some types of cancer.
To make the oestradiol sensor, the researchers designed two layers of material to work in tandem — an interface seeded with oestradiol-recognizing aptamers, and a gold-nanoparticle electrode covered in a material called MXene, which further enhances weak electrical signals. The aptamers are preloaded with single-stranded DNA that has been tagged with methylene blue, a dye that in this cases serves as an electrochemical probe.
Researchers have designed a wearable, ring-like biosensor for monitoring the hormone oestradiol in human sweat.
The technology is a fast-acting, non-invasive advance over conventional methods for tracking fertility and women’s health.
Whereas most biosensors use antibodies or enzymes to target proteins, Gao’s relies on aptamers — short bits of single-stranded DNA or RNA that are designed to fold such that they bind to targets ranging from small molecules to toxins. Although sometimes referred to as chemical antibodies, aptamers are much smaller than most antibodies and can be synthesized chemically, rather than in laboratory animals.
Researchers have previously designed aptamers to recognize cortisol, serotonin, caffeine and even some types of cancer.
To make the oestradiol sensor, the researchers designed two layers of material to work in tandem — an interface seeded with oestradiol-recognizing aptamers, and a gold-nanoparticle electrode covered in a material called MXene, which further enhances weak electrical signals. The aptamers are preloaded with single-stranded DNA that has been tagged with methylene blue, a dye that in this cases serves as an electrochemical probe.
Nature
Wearable biosensor measures fertility hormones in sweat
Nature - Ring-like device blends nanoelectronics and folded RNA to track hormone levels without the need for invasive blood tests.
❤3
#books This book will change how you look at biology. Truly outstanding treatment of the genetic and cellular world.
👍4
AI-generated human videos from pose detection is coming with Alibaba researcher's new 'Animate Anyone'.
GitHub
[Official Updates] Follow-up plans for the project · Issue #12 · HumanAIGC/AnimateAnyone
Thank you all for your incredible support and interest in our project. We've received lots of inquiries regarding a demo or the source code. We want to assure you that we are actively working o...
👍2
OpenBCI launches a neuro-powered spatial computer
Galea Beta device includes a range of sensors that simultaneously measure the user’s heart, skin, muscles, eyes, and brain.
Galea Beta includes eye-tracking and displays from Finnish headset-maker, Varjo and can be ordered with the Varjo Aero, XR-3 or the recently announced XR-4.
The Galea Beta sensors can be used without the HMD, or can be tethered to a high-powered PC and used for collecting data from VR and XR environments.
Long-term goal for Galea is to bring everything you see on the table, together into one device. Optics, CPU, I/O and sensors, in one tightly synchronized integrated system.
Galea Beta device includes a range of sensors that simultaneously measure the user’s heart, skin, muscles, eyes, and brain.
Galea Beta includes eye-tracking and displays from Finnish headset-maker, Varjo and can be ordered with the Varjo Aero, XR-3 or the recently announced XR-4.
The Galea Beta sensors can be used without the HMD, or can be tethered to a high-powered PC and used for collecting data from VR and XR environments.
Long-term goal for Galea is to bring everything you see on the table, together into one device. Optics, CPU, I/O and sensors, in one tightly synchronized integrated system.
OpenBCI Community
OpenBCI unveils vision for wearable, neuro-powered personal computer at Slush 2023
OpenBCI unveils vision for wearable, neuro-powered personal computer at Slush 2023. Latest Galea Beta device was revealed for the first time on-stage, along with OpenBCI’s future vision for "Galea Unlimited" wearable computer.
👍3
According to a Chinese computer scientist who asked not to be named, the new Sunway is not the most powerful supercomputer in China at present.
But after details of it were given at the Supercomputing 2023 (SC23) conference in Denver, US, earlier this month, it gave the public some hints on how China has managed to sidestep US sanctions to build its own supercomputers.
This Chinese dark horse has also outdone leading supercomputers, including the Frontier, in computing efficiency.
It can maintain over 85 per cent of its peak performance in regular operation, ranking the highest among all heterogeneous systems – a type of common supercomputing architecture – and second among all systems.
Meanwhile, China’s most powerful supercomputer remains undisclosed and other supercomputing chips are also under development, according to the Chinese scientist who works at a top mainland university.
But after details of it were given at the Supercomputing 2023 (SC23) conference in Denver, US, earlier this month, it gave the public some hints on how China has managed to sidestep US sanctions to build its own supercomputers.
This Chinese dark horse has also outdone leading supercomputers, including the Frontier, in computing efficiency.
It can maintain over 85 per cent of its peak performance in regular operation, ranking the highest among all heterogeneous systems – a type of common supercomputing architecture – and second among all systems.
Meanwhile, China’s most powerful supercomputer remains undisclosed and other supercomputing chips are also under development, according to the Chinese scientist who works at a top mainland university.
South China Morning Post
New Sunway supercomputer hints at how China sidestepped US sanctions
Chip war between US and China fails to stop scientists building one of the top supercomputers in the world.
A very important sleep study came out
Sleep has a huge impact on someone's health and even health span, but now it seems that "sleep regularity is an important predictor of mortality risk and is a stronger predictor than sleep duration."
Thus sleep regularity should be a simple, yet effective target for improving general health and survival.
Sleep has a huge impact on someone's health and even health span, but now it seems that "sleep regularity is an important predictor of mortality risk and is a stronger predictor than sleep duration."
Thus sleep regularity should be a simple, yet effective target for improving general health and survival.
OUP Academic
Sleep regularity is a stronger predictor of mortality risk than sleep duration: A prospective cohort study
Abstract. Abnormally short and long sleep are associated with premature mortality, and achieving optimal sleep duration has been the focus of sleep health guide
⚡4
Google has quietly delayed the public debut of Gemini to January
Sundar Pichai recently decided to scrap a series of Gemini events, originally scheduled this week after the company found the AI didn’t reliably handle some non-English queries.
It’s rare for Google to launch a major product between Thanksgiving and the end of the year, but Google intended to make an exception for Gemini because it’s arguably the company’s most important initiative in a decade.
The Gemini event in Washington was intended to showcase the technology to policymakers and politicians, which have increasingly discussed potential regulations involving AI.
Sundar Pichai recently decided to scrap a series of Gemini events, originally scheduled this week after the company found the AI didn’t reliably handle some non-English queries.
It’s rare for Google to launch a major product between Thanksgiving and the end of the year, but Google intended to make an exception for Gemini because it’s arguably the company’s most important initiative in a decade.
The Gemini event in Washington was intended to showcase the technology to policymakers and politicians, which have increasingly discussed potential regulations involving AI.
The Information
Google Preps Public Preview of Gemini AI After Postponing In-Person Launch Events
Update, Dec.4: After Google quietly scrapped a set of in-person events to launch Gemini, its biggest artificial intelligence initiative in a decade, the company has planned a virtual preview of the new AI as soon as this week, said a person with knowledge…
❤1
No GPU but wanna create your own LLM on laptop?
Here is a QLoRA on CPU, making LLM fine-tuning on client CPU possible.
Code.
Here is a QLoRA on CPU, making LLM fine-tuning on client CPU possible.
Code.
Medium
Creating Large Language Models on Your Laptop
Making Fine-Tuning Possible on Your Personal Computer
Taiwan's National Science and Technology Council has published a list of key technologies that are significant to Taiwan's national security: semiconductor manufacturing process technology under 14 nm included.