Duke Engineers have developed a new type of microscope that uses a bowl studded with LED lights of various colors and lighting schemes produced by machine learning
Prototype microscope teaches itself the best illumination settings for diagnosing malaria
Engineers at Duke University have developed a microscope that adapts its lighting angles, colors and patterns while teaching itself the optimal settings needed to complete a given diagnostic task.
In the initial proof-of-concept study, the microscope simultaneously developed a lighting pattern and classification system that allowed it to quickly identify red blood cells infected by the malaria parasite more accurately than trained physicians and other machine learning approaches.
The results appear online on November 19 in the journal Biomedical Optics Express.
“A standard microscope illuminates a sample with the same amount of light coming from all directions, and that lighting has been optimized for human eyes over hundreds of years,” said Roarke Horstmeyer, assistant professor of biomedical engineering at Duke.
“But computers can see things humans can’t,” Hortmeyer said. “So not only have we redesigned the hardware to provide a diverse range of lighting options, we’ve allowed the microscope to optimize the illumination for itself.”
Rather than diffusing white light from below to evenly illuminate the slide, the engineers developed a bowl-shaped light source with LEDs embedded throughout its surface. This allows samples to be illuminated from different angles up to nearly 90 degrees with different colors, which essentially casts shadows and highlights different features of the sample depending on the pattern of LEDs used.
The researchers then fed the microscope hundreds of samples of malaria-infected red blood cells prepared as thin smears, in which the cell bodies remain whole and are ideally spread out in a single layer on a microscope slide. Using a type of machine learning algorithm called a convolutional neural network, the microscope learned which features of the sample were most important for diagnosing malaria and how best to highlight those features.
The algorithm eventually landed on a ring-shaped LED pattern of different colors coming from relatively high angles. While the resulting images are noisier than a regular microscope image, they highlight the malaria parasite in a bright spot and are correctly classified about 90 percent of the time. Trained physicians and other machine learning algorithms typically perform with about 75 percent accuracy.
“The patterns it’s picking out are ring-like with different colors that are non-uniform and are not necessarily obvious,” said Horstmeyer. “Even though the images are dimmer and noisier than what a clinician would create, the algorithm is saying it’ll live with the noise, it just really wants to get the parasite highlighted to help it make a diagnosis.”
Horstmeyer then sent the LED pattern and sorting algorithm to another collaborator’s lab across the world to see if the results were translatable to different microscope setups. The other laboratory showed similar successes.
“Physicians have to look through a thousand cells to find a single malaria parasite,” said Horstmeyer. “And because they have to zoom in so closely, they can only look at maybe a dozen at a time, and so reading a slide takes about 10 minutes. If they only had to look at a handful of cells that our microscope has already picked out in a matter of seconds, it would greatly speed up the process.”
The researchers also showed that the microscope works well with thick blood smear preparations, in which the red blood cells form a highly non-uniform background and may be broken apart. For this preparation, the machine learning algorithm was successful 99 percent of the time.
The new microscope taught itself the best way to light up red blood cells to spot malaria parasites within. Compared to a traditional microscope (top), the red blood cell images created by the new microscope (bottom) contain more noise, but the malaria parasites are lit up by bright patches due to the lighting conditions.
According to Horstmeyer, the improved accuracy is expected because the tested thick smears were more heavily stained than the thin smears and exhibited higher contrast. But they also take longer to prepare, and part of the motivation behind the project is to cut down on diagnosis times in low-resource settings where trained physicians are sparse and bottlenecks are the norm.
With this initial success in hand, Horstmeyer is continuing to develop both the microscope and machine learning algorithm.
A group of Duke engineering graduate students has formed a startup company SafineAI to miniaturize the reconfigurable LED microscope concept, which has already earned a $120,000 prize at a local pitch competition.
Meanwhile, Horstmeyer is working with a different machine learning algorithm to create a version of the microscope that can adjust its LED pattern to any specific slide it’s trying to read.
“We’re basically trying to impart some brains into the image acquisition process,” said Horstmeyer. “We want the microscope to use all of its degrees of freedom. So instead of just dumbly taking images, it can play around with the focus and illumination to try to get a better idea of what’s on the slide, just like a human would.”
Learn more: Machine Learning Microscope Adapts Lighting to Improve Diagnoses
The Latest on: Machine learning microscope
- Modifications make a smarter microscopeon November 26, 2019 at 8:56 am
The approach was tested with hundreds of samples of malaria-infected red blood cells prepared as thin smears, in which the cell bodies remain whole and are spread out in a single layer on a microscope ...
- Microscope Teaches Itself the Best Lighting to Improve Diagnosison November 23, 2019 at 5:05 am
Using a type of machine learning algorithm called a convolutional neural network, the microscope learned which features of the sample were most important for diagnosing malaria and how best to ...
- Novel Microscope Self-Trains on Best Illumination Settings to Diagnose Malariaon November 22, 2019 at 1:32 am
Duke Engineers have developed a new type of microscope that uses a bowl studded with LED lights of various colors and lighting schemes produced by machine learning. Image Credit: Duke University.
- Novel microscope optimizes illumination to improve diagnosison November 20, 2019 at 12:48 pm
In the initial proof-of-concept study, the microscope simultaneously developed a lighting pattern and classification system that allowed it to quickly identify red blood cells infected by the malaria ...
- Machine learning microscope adapts lighting to improve diagnosison November 20, 2019 at 9:39 am
in which the cell bodies remain whole and are ideally spread out in a single layer on a microscope slide. Using a type of machine learning algorithm called a convolutional neural network, the ...
- A computer model has learned to detect prostate canceron November 19, 2019 at 4:19 am
Using machine learning, a computer model was taught to distinguish between healthy tissues ... Then experts make thin sections and examine these slides under a microscope. According to Yuri Kistenev, ...
- The difference between an expert's brain and a novice'son November 18, 2019 at 8:03 am
Using a two-photon imaging microscope and a wealth of genetic tools ... The researchers decoded neural activity by training a small artificial network called the 'Linear Support Vector Machine' using ...
- At 46.83%+ CAGR, AI In Aviation Market Size is Expected to Exhibit 1014.81 Mn USD by 2023on November 15, 2019 at 3:01 am
Nov 15, 2019 (AmericaNewsHour) -- AI In Aviation Market Research Report by Type (Hardware, Software, Services), Equipment (Autocollimator, Measuring Microscope, Profile Projector, and Others), ...
- Machine Learning-Based Analysis of Sperm Videos and Participant Data for Male Fertility Predictionon November 14, 2019 at 2:58 am
Thus, machine learning-based automatic analysis may become a valuable tool for the future of male infertility investigation. Our main approach is the use of CNNs to analyze sequences of frames from ...
- New Scanning Transmission Electron Microscope Features Smart Alignment Softwareon November 12, 2019 at 4:00 pm
Incorporating machine learning into the instrument helps minimize the time needed to develop automated recipes, allowing more productive utilization of the microscope. Built on Thermo Fisher's ...
via Bing News
The Latest on: Smart microscope
- Reel Talk: This who-dunnit crime story takes you on mystery rideon November 29, 2019 at 6:20 am
This, of course, would change the cause of death from suicide to murder and now puts each and every family member under the microscope as suspects. Oh ... His character of “Harlan” is smart and strong ...
- A Virtual Hospital, A Nav App For The Blind, An AR Microscope: Israel Showcases Digital Health Techon November 28, 2019 at 4:53 am
Augmentiqs, for example, an Israeli startup founded in 2016, showcased how it turns microscopes – an analog medical instrument – into an augmented reality device that allows for real-time, smart ...
- How The New Calendar Can Help Address The Biggest Problem For The GAAon November 27, 2019 at 5:00 am
The American inventor and engineer, whose prowess earned him the moniker 'the boss', had a smart and simple starting point ... How does it look under the microscope? Put simply, the issue is a lack of ...
- Best Black Friday Tech and Science Gift Dealson November 25, 2019 at 2:32 pm
As with smart watches, Apple probably seems like the go-to brand for wireless earbuds ... Buy the Samsung 43″ 4K UHD TV here. An LCD Digital Microscope? Oh yes, we had your curiosity, but now we know ...
- Georgia should stay at No. 4 in CFP rankings, but Dawgs didn't look the part against Texas A&Mon November 25, 2019 at 1:18 pm
While a blowout win over the Texas A&M Aggies on Saturday at Sanford Stadium was never likely, Georgia football fans — and even coach Kirby Smart — would have preferred a little more ... where how a ...
- A flawed gimmick we just don't need - YOUR verdict on smart meterson November 23, 2019 at 6:01 pm
The roll-out of so-called 'smart' meters is in crisis – with hundreds of readers alerting us to problems after our report earlier this month when we put the flawed new equipment under the microscope.
- Jose Mourinho under the microscopeon November 23, 2019 at 3:01 pm
coming on with 11 minutes to go — with Mourinho hinting before the match that the… Want to read more? Subscribe now and get unlimited digital access on web and our smartphone and tablet apps, free for ...
- Make your smartphone a microscope with this device — Future Blinkon November 22, 2019 at 12:41 pm
Mashable is a global, multi-platform media and entertainment company. Powered by its own proprietary technology, Mashable is the go-to source for tech, digital culture and entertainment content for ...
- Smart Microscope Learns to Diagnose Infectious Diseaseson November 22, 2019 at 12:23 pm
Cytologists who evaluate cells under a microscope become more consistent and accurate when they know how to prep their apparatus to produce clear images. Researchers at Duke University have now given ...
- If You've Ever Wanted a Smartphone Microscope, Now's Your Chanceon November 22, 2019 at 8:20 am
SmartMicroOptics—a spinoff of the Italian Institute of Technology, based in Genoa—has invented the smartphone microscope to make the study of microscopic organisms and structures accessible to all. At ...
via Bing News