When you do a simple Web search on a topic, the results that pop up aren’t the whole story. The Internet contains a vast trove of information — sometimes called the “Deep Web” — that isn’t indexed by search engines: information that would be useful for tracking criminals, terrorist activities, sex trafficking and the spread of diseases. Scientists could also use it to search for images and data from spacecraft.
The Defense Advanced Research Projects Agency (DARPA) has been developing tools as part of its Memex program that access and catalog this mysterious online world. Researchers at NASA’s Jet Propulsion Laboratory in Pasadena, California, have joined the Memex effort to harness the benefits of deep Web searching for science. Memex could, for example, help catalog the vast amounts of data NASA spacecraft deliver on a daily basis.
“We’re developing next-generation search technologies that understand people, places, things and the connections between them,” said Chris Mattmann, principal investigator for JPL’s work on Memex.
Memex checks not just standard text-based content online but also images, videos, pop-up ads, forms, scripts and other ways information is stored to look at how they are interrelated.
“We’re augmenting Web crawlers to behave like browsers — in other words, executing scripts and reading ads in ways that you would when you usually go online. This information is normally not catalogued by search engines,” Mattmann said.
Additionally, a standard Web search doesn’t get much information from images and videos, but Memex can recognize what’s in this content and pair it with searches on the same subjects. The search tool could identify the same object across many frames of a video or even different videos.
The video and image search capabilities of Memex could one day benefit space missions that take photos, videos and other kinds of imaging data with instruments such as spectrometers. Searching visual information about a particular planetary body could greatly facilitate the work of scientists in analyzing geological features. Scientists analyzing imaging data from Earth-based missions that monitor phenomena such as snowfall and soil moisture could similarly benefit.
Memex would also enhance the search for published scientific data, so that scientists can be better aware of what has been released and analyzed on their topics. The technology could be applied to large NASA data centers such as the Physical Oceanography Distributed Active Archive Center, which makes NASA’s ocean and climate data accessible and meaningful. Memex would make PDF documents more easily searchable and allow users to more easily arrive at the information they seek. Awareness of existing publications also helps program managers to assess the impact of spacecraft data.
All of the code written for Memex is open-source. JPL is one of 17 teams working on it as part of the DARPA initiative.
Read more: ‘Deep Web Search’ May Help Scientists
The Latest on: Deep Web
via Google News
The Latest on: Deep Web
- Navigating the deep, dark webon January 16, 2020 at 2:00 am
Deep web. Dark web. They’re different, and the terms can be confusing. “Everybody uses the deep web, even Facebook is considered the deep web,” says Mike Holcomb, director of information security at ...
- Broadway In Chicago Has Released IN TOO DEEP Web Series Episode Featuring The Plastics Of MEAN GIRLS Touron January 13, 2020 at 11:06 am
Direct from the Mean Girls National Tour, Mariah Rose Faith, Jonalyn Saxer, and Megan Masako Haley get In Too Deep with T.J. Pieffer as they contemplate Sondheim, Luigi, and Giordano's Deep Dish Pizza ...
- The Dark Web: What you need to know about this mysterious digital worldon January 13, 2020 at 6:02 am
This article is reprinted by permission from NextAvenue.org. Below the surface, the internet you recognize and use for your browsing is a shadowy, digital netherworld. According to a report by ...
- “Deep Web” Drug Peddling Site Atlantis Begins Advertising Pushon January 5, 2020 at 4:00 pm
Actually, Atlantis isn’t the first web-based black market. Silk Road, launched in 2011, pioneered the anonymous online drug trade. It utilizes what many call the “deep web,” which includes ...
- What is the Deep Web and how to access iton January 5, 2020 at 2:48 pm
What is the Deep Web? Did you know that the internet you are used to, the Internet, only makes up a tiny percentage of the actual web out there? There is something that is bigger than this web by ...
- Internet: Deep web and Dark web..The origin of Dark webon December 25, 2019 at 6:47 am
Internet has become like oxygen for us nowadays. The internet you use, is only four or five percent of the internet. There’s a lot you don’t know, the world of internet that not everyone can ...
- SciTech Patent Art (SPA)'s customized news feed engages Deep Web crawling to provide consumer and technology insights.on December 18, 2019 at 10:40 pm
Unique features of this service include: Being configured to monitor specific companies and technologies Structured data, gathered by using SPA’s Deep Web search platform All relevant news ...
- Can Google Index the Deep & Dark Web?on December 15, 2019 at 12:55 pm
The Deep Web is estimated to be 400 to 550 times bigger than that — and none of it is indexed by Google. An overview of content types on the Surface, Deep, & Dark Webs. The Deep Web is comprised ...
- Deep Web Drug Dealers Are Freaking Out About The Bitcoin Crashon October 19, 2019 at 5:00 pm
REUTERS/Enrique Castro-Mendivil All manner of illegal drugs are available on the deep web ... And it turns out drug dealers are freaking out about the price crash just as much as everyone ...
- Tip: Five tips on finding rare information on the deep webon October 2, 2019 at 5:10 am
To help you harvest information on the deep web, Leonie Kijewski rounded up these five tips from German journalist Albrecht Ude who spoke at at the 11th Global Investigative Journalism Conference.
via Bing News