When you do a simple Web search on a topic, the results that pop up aren’t the whole story. The Internet contains a vast trove of information — sometimes called the “Deep Web” — that isn’t indexed by search engines: information that would be useful for tracking criminals, terrorist activities, sex trafficking and the spread of diseases. Scientists could also use it to search for images and data from spacecraft.
The Defense Advanced Research Projects Agency (DARPA) has been developing tools as part of its Memex program that access and catalog this mysterious online world. Researchers at NASA’s Jet Propulsion Laboratory in Pasadena, California, have joined the Memex effort to harness the benefits of deep Web searching for science. Memex could, for example, help catalog the vast amounts of data NASA spacecraft deliver on a daily basis.
“We’re developing next-generation search technologies that understand people, places, things and the connections between them,” said Chris Mattmann, principal investigator for JPL’s work on Memex.
Memex checks not just standard text-based content online but also images, videos, pop-up ads, forms, scripts and other ways information is stored to look at how they are interrelated.
“We’re augmenting Web crawlers to behave like browsers — in other words, executing scripts and reading ads in ways that you would when you usually go online. This information is normally not catalogued by search engines,” Mattmann said.
Additionally, a standard Web search doesn’t get much information from images and videos, but Memex can recognize what’s in this content and pair it with searches on the same subjects. The search tool could identify the same object across many frames of a video or even different videos.
The video and image search capabilities of Memex could one day benefit space missions that take photos, videos and other kinds of imaging data with instruments such as spectrometers. Searching visual information about a particular planetary body could greatly facilitate the work of scientists in analyzing geological features. Scientists analyzing imaging data from Earth-based missions that monitor phenomena such as snowfall and soil moisture could similarly benefit.
Memex would also enhance the search for published scientific data, so that scientists can be better aware of what has been released and analyzed on their topics. The technology could be applied to large NASA data centers such as the Physical Oceanography Distributed Active Archive Center, which makes NASA’s ocean and climate data accessible and meaningful. Memex would make PDF documents more easily searchable and allow users to more easily arrive at the information they seek. Awareness of existing publications also helps program managers to assess the impact of spacecraft data.
All of the code written for Memex is open-source. JPL is one of 17 teams working on it as part of the DARPA initiative.
Read more:Â ‘Deep Web Search’ May Help Scientists
The Latest on: Deep Web
[google_news title=”” keyword=”Deep Web” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Deep Web
- Supporting A Deep Tech Innovation Ecosystem With Intel Igniteon April 17, 2024 at 5:45 am
The Ignite program is part of Intel’s effort to keep a pipeline of companies working on difficult technical problems.
- What Is the Dark Web?on April 16, 2024 at 5:01 pm
Dark Web vs. Deep Web The dark web and the deep web are also often erroneously used interchangeably. The dark web is one part of the deep web, also called the invisible web or the hidden web.
- How to Browse the Dark Webon April 1, 2024 at 5:00 pm
I'll start with the deep web: That's everything online that isn't indexed by regular search engines, so that includes pages locked behind paywalls, private databases, email archives, company ...
- What is the dark web? How to access it and what you’ll findon April 1, 2024 at 5:00 pm
Just don’t buy anything there. The terms “deep web” and “dark web” are sometimes used interchangeably, but they are not the same. Deep web refers to anything on the internet that is not ...
- The dark web’s two faces: Charity fundraisers alongside extortion and kidnappingon March 21, 2024 at 4:50 am
The dark web harbors a wide range of sinister activities like murder for hire, weapons and illegal drugs for sale, distribution of child pornography, as well as robbery, kidnapping, extortion and ...
- The Deep Web: Murdershowon October 8, 2023 at 3:57 am
Dan Zachary A podcaster's search for clues into his sisters death lands him on the deep web where uncovers THE MURDERSHOW, a site where the highest crypto bidder selects how the victim will be killed.
- The 12 Best Deep Search Engines to Explore the Invisible Webon June 23, 2023 at 10:25 am
To explore the invisible web, you need to use specialist search engines. Here are our top 12 services to perform a deep internet search. Before we begin, let's establish what does the term ...
- The Deep Web: Murdershowon February 14, 2023 at 12:02 am
25 Most Popular TV Shows Right Now: What to Watch on Streaming Link to 25 Most Popular TV Shows Right Now: What to Watch on Streaming 30 Most Popular Movies Right Now: What to Watch In Theaters ...
- Deep Web XXXon January 16, 2023 at 4:04 pm
Robbie Hampstead Domiziano Cristopharo, Jason Impey, Elisa Carrera Fumagalli, Martyna Madej A collection of disturbing, sick, morbid and unusual clips from the world wide web. Advertisement ...
- Advantages, Disadvantages and Risks of Deep Web Search Engineson July 21, 2018 at 9:21 pm
The Right Tools for the Job While Deep Web search engines like Infomine, CompletePlanet, Deep Dyve or TechXtra can locate hidden material, other tools may be needed to view it. Many Deep Web ...
via Bing News