When you do a simple Web search on a topic, the results that pop up aren’t the whole story. The Internet contains a vast trove of information — sometimes called the “Deep Web” — that isn’t indexed by search engines: information that would be useful for tracking criminals, terrorist activities, sex trafficking and the spread of diseases. Scientists could also use it to search for images and data from spacecraft.
The Defense Advanced Research Projects Agency (DARPA) has been developing tools as part of its Memex program that access and catalog this mysterious online world. Researchers at NASA’s Jet Propulsion Laboratory in Pasadena, California, have joined the Memex effort to harness the benefits of deep Web searching for science. Memex could, for example, help catalog the vast amounts of data NASA spacecraft deliver on a daily basis.
“We’re developing next-generation search technologies that understand people, places, things and the connections between them,” said Chris Mattmann, principal investigator for JPL’s work on Memex.
Memex checks not just standard text-based content online but also images, videos, pop-up ads, forms, scripts and other ways information is stored to look at how they are interrelated.
“We’re augmenting Web crawlers to behave like browsers — in other words, executing scripts and reading ads in ways that you would when you usually go online. This information is normally not catalogued by search engines,” Mattmann said.
Additionally, a standard Web search doesn’t get much information from images and videos, but Memex can recognize what’s in this content and pair it with searches on the same subjects. The search tool could identify the same object across many frames of a video or even different videos.
The video and image search capabilities of Memex could one day benefit space missions that take photos, videos and other kinds of imaging data with instruments such as spectrometers. Searching visual information about a particular planetary body could greatly facilitate the work of scientists in analyzing geological features. Scientists analyzing imaging data from Earth-based missions that monitor phenomena such as snowfall and soil moisture could similarly benefit.
Memex would also enhance the search for published scientific data, so that scientists can be better aware of what has been released and analyzed on their topics. The technology could be applied to large NASA data centers such as the Physical Oceanography Distributed Active Archive Center, which makes NASA’s ocean and climate data accessible and meaningful. Memex would make PDF documents more easily searchable and allow users to more easily arrive at the information they seek. Awareness of existing publications also helps program managers to assess the impact of spacecraft data.
All of the code written for Memex is open-source. JPL is one of 17 teams working on it as part of the DARPA initiative.
Read more: ‘Deep Web Search’ May Help Scientists
The Latest on: Deep Web
via Google News
The Latest on: Deep Web
- The Deep and Dark Web Guide - Free downloadon July 30, 2020 at 1:46 pm
Thanks to our partners, you can download this guide for free for a limited time, and If you're curious to learn more about the dark web, this guide will give you a fair introduction to the subject.
- What is the Deep Web and how to access iton July 22, 2020 at 7:38 am
What is the Deep Web? Did you know that the internet you are used to, the Internet, only makes up a tiny percentage of the actual web out there? There is something that is bigger than this web by ...
- Deep Webon July 21, 2020 at 7:19 am
Deep Web Not Yet Rated 1 hr 20 min Horror A gamer meets a girl on an online forum who introduces him to the deep web an underground network where anything is possible.
- What is the deep web?on July 21, 2020 at 5:36 am
The term ‘Deep Web’ is used to refer to these non-indexed pages, which can include web mail, online banking or services that sit behind a pay wall. For example, a staff intranet or CMS system ...
- More Details Emerge Of How Police Shut Down Over 400 Deep Web Marketplaces As Part Of 'Operation Onymous'on July 16, 2020 at 5:00 pm
Police forces from across Europe worked with the US and spent over six months co-ordinating a large-scale raid on the deep web that has seen over 400 illegal marketplaces taken offline.
- Tag: deep webon July 12, 2020 at 5:00 pm
Hypertext is one of South Africa’s leading technology news and reviews sites, catering for consumers, small and medium businesses and the technology channel. We publish original content daily ...
- The 'Deep Web' installation is a ballet of high-precision laserson July 12, 2020 at 5:00 pm
Mashable is a global, multi-platform media and entertainment company. Powered by its own proprietary technology, Mashable is the go-to source for tech, digital culture and entertainment content ...
- Investigators Use New Tool To Comb Deep Web For Human Traffickerson July 6, 2020 at 9:30 am
It's time for All Tech Considered. (SOUNDBITE OF MUSIC) SIEGEL: You may have heard of the deep web and the dark web. They sound insidious, but they actually describe the majority of the Internet.
- The Deep Web, darknets, Bitcoin and brand protectionon July 5, 2020 at 5:00 pm
Abuse in the Deep Web can be broad and hidden, with cybersquatters and fraudsters trying to ply their trade. However, once detected, there are means to identify the perpetrators and to enforce IP ...
- Search Engine with Roots in Genomics Unlocks Deep Webon June 24, 2020 at 5:01 pm
Nov. 12, 2008 | DeepDyve is designed to search the 99 percent (they say, citing a study from UC Berkeley) of hits not picked up by other search engines, which return pages based largely on ...
via Bing News