When you do a simple Web search on a topic, the results that pop up aren’t the whole story. The Internet contains a vast trove of information — sometimes called the “Deep Web” — that isn’t indexed by search engines: information that would be useful for tracking criminals, terrorist activities, sex trafficking and the spread of diseases. Scientists could also use it to search for images and data from spacecraft.
The Defense Advanced Research Projects Agency (DARPA) has been developing tools as part of its Memex program that access and catalog this mysterious online world. Researchers at NASA’s Jet Propulsion Laboratory in Pasadena, California, have joined the Memex effort to harness the benefits of deep Web searching for science. Memex could, for example, help catalog the vast amounts of data NASA spacecraft deliver on a daily basis.
“We’re developing next-generation search technologies that understand people, places, things and the connections between them,” said Chris Mattmann, principal investigator for JPL’s work on Memex.
Memex checks not just standard text-based content online but also images, videos, pop-up ads, forms, scripts and other ways information is stored to look at how they are interrelated.
“We’re augmenting Web crawlers to behave like browsers — in other words, executing scripts and reading ads in ways that you would when you usually go online. This information is normally not catalogued by search engines,” Mattmann said.
Additionally, a standard Web search doesn’t get much information from images and videos, but Memex can recognize what’s in this content and pair it with searches on the same subjects. The search tool could identify the same object across many frames of a video or even different videos.
The video and image search capabilities of Memex could one day benefit space missions that take photos, videos and other kinds of imaging data with instruments such as spectrometers. Searching visual information about a particular planetary body could greatly facilitate the work of scientists in analyzing geological features. Scientists analyzing imaging data from Earth-based missions that monitor phenomena such as snowfall and soil moisture could similarly benefit.
Memex would also enhance the search for published scientific data, so that scientists can be better aware of what has been released and analyzed on their topics. The technology could be applied to large NASA data centers such as the Physical Oceanography Distributed Active Archive Center, which makes NASA’s ocean and climate data accessible and meaningful. Memex would make PDF documents more easily searchable and allow users to more easily arrive at the information they seek. Awareness of existing publications also helps program managers to assess the impact of spacecraft data.
All of the code written for Memex is open-source. JPL is one of 17 teams working on it as part of the DARPA initiative.
Read more: ‘Deep Web Search’ May Help Scientists
The Latest on: Deep Web
via Google News
The Latest on: Deep Web
- A Story to Bind Us: The Intellectual Deep Web and a New Meta-Narrativeon September 2, 2019 at 9:42 am
We know ourselves through stories, and we know each other through the stories we share. But for all the beauty of stories, we are drowning in them. This is, after all, the promise of postmodernism; ...
- What is the Deep Web and how to access iton September 2, 2019 at 1:52 am
What is the Deep Web? Did you know that the internet you are used to, the Internet, only makes up a tiny percentage of the actual web out there? There is something that is bigger than this web by up ...
- The ‘deep web’: vast and uncharted … until nowon August 31, 2019 at 5:00 pm
3? have become a tremendous source of frustration for educators and researchers who can’t find the information they need with a few keystrokes. “These days, it seems like search engines are a little ...
- Deep Web or Dark Web what is it really?on July 31, 2019 at 10:21 am
In recent years there are plenty of headlines in terms of deep web and dark web and it is some kind of mysterious place that most of media couldn’t access to it. In this article, i’m going to open ...
- "DEEP WEB" – A sculpture of music and lighton July 22, 2019 at 5:26 am
The DEEP WEB light installation by Christopher Bauder is currently showing in the former power plant Kraftwerk Berlin. Visitors are immersed in an installation created from laser lines and dots and ...
- Hackers disclose Russian deep-web 'Tor' data storing projecton July 22, 2019 at 1:03 am
A hacking group that goes by the nickname '0v1ru$' has disclosed some secret Russian spy projects, some of these projects were designed to store, monitor and decipher Tor users data. The company that ...
- Broadway In Chicago Releases IN TOO DEEP Web Series; Premiere Episode Features Nick Cartell & Jillian Butler Of LES MISERABLESon July 16, 2019 at 5:00 pm
Broadway In Chicago has premiered the first episode of it's new talk show series IN TOO DEEP hosted and created by T.J. Pieffer. Each episode will feature Pieffer talking to cast members of touring ...
- How to tell the dark web from the deep webon May 16, 2019 at 5:00 pm
You’ve heard about the “dark web” and the “deep web,” but you aren’t exactly sure what they are, nor what the difference is between them. We'll help you understand these two parts of the Internet, and ...
- How to do a Deep Web search and why you shouldon April 17, 2019 at 5:00 pm
There are millions of websites on the internet. Here, you'll find everything from CNN.com to YouTube cooking channels. But you might not realize what you're seeing online is only a fraction of what's ...
- How to tell the deep web from the dark webon January 20, 2019 at 5:13 am
The dark web vs deep web is a question that a great number of internet noobs wonder about. Most of us actually access the deep web every day, whether it’s by logging on to Facebook or checking our ...
via Bing News