Synology BeeDrive Deep Search

Synology BeeDrive Deep Search

As it was announced a few weeks ago, the new 2.0.0-20082 BeeDrive desktop app version has arrived as the latest beta.

Synology’s BeeDrive AI Search Engine announcement
#Synology #BeeDrive desktop app is getting some deep search #AI power! Search text, images, and documents, with natural input, location and metadata

Announcement of the new Deep Search functionality with 2.0 version of BeeDrive desktop app for macOS

The new BeeDrive with Deep Search is currently supported only on Apple Silicon Macs running macOS 15 or newer. It requires M-architecture CPUs and 16GB of RAM. It is expected to become available on select Windows PCs with specific hardware later this year.

For anyone not familiar with the BeeDrive desktop app or BeeDrive device in general be sure to read up on it in the following review that was published two years ago when the model was first released.

Synology BeeDrive review
Review of the new Synology DAS device, the BeeDrive. This compact USB is more than meets the eye. Packed with powerful software it will deliver in more ways than one.

Full review of the BeeDrive

This is the first major new version of the software since its release and Synology decided to pack it with some AI functionalities as the rest of the DSM productivity apps.

The idea behind Deep Search was an offline* search AI engine that would allow for a fast search capability utilizing "intelligence" as well as text recognition. Taking into account that the BeeDrive is a 10G capable DAS device, paired with an M-architecture Mac machine there is much to desire in terms of speed and result presentation.

Deep Search is a new feature in an already interesting set of possibilities that the BeeDrive desktop app offers.

Installation

As with any desktop app, the whole process starts with an installation. Presently, Deep Search is currently in beta so the BeeDrive app needs to be downloaded from the Synology beta channel page.

BeeDrive beta
Welcome to BeeDrive beta. Get early access to the latest features on BeeDrive.
The installation will use just a little under 700MB of disk space but that is not all
Deep Search as a dedicated section inside the new BeeDrive 2.0 beta

The installation alone will not be enough to get the Deep Search up and running. The macOS needs to allow full disk access permission for the BeeDrive before it can be utilized.

Allow full disk access for the BeeDrive on the macOS
BeeDrive detected

Upon successful installation, we can now start and configure the Deep Search feature using the BeeDrive main UI.

With a simple "enable" button the macOS will start downloading and configuring the Deep Search tool. Downloading it means the needed AI models will be pulled from the Internet to maintain the "off-grid" functionality.

Once the BeeDrive has been detected and allowed full disk access we can now start the Deep Search
Download of AI models in progress
BeeDrive Deep Search being configured

In case anyone is wondering, BeeDrive uses several models that cover both semantic search and indexing as well as image and text recognition. As we can see, inside the macOS Application Support/BeeDrive folder structure there is an additional 2.6GB of occupied space.

1.4GB of those is dedicated to the AI models by Alibaba NLP, as well as Microsoft Florence 2. The rest goes against three BeeDrive apps for photo recognition, indexing, and document analysis.

Looks like Synology decided to utilize Chinize as well as US models to power this new feature, so make use of that information at your accord.

Deep Search settings

Now that we have Deep Search up and ready we have a few configuration settings that can be set up. Nothing fancy, but still, it offers the end user some flexibility.

It will be up to us to allow document and/or image search
🚨
WARNING: searching photos by GPS data location will require Internet access as well as in the case of search query translation!

Multi-language search is possible on selected languages (in some cases search query might use the Internet beyond a pure macOS native translation service

Primarily, we have the document and image search capabilities, that will in some cases, if explicitly allowed, utilize the Internet to assist in translation and GPS data comparison. Speaking of translation and supported search languages, Deep Search supports twelve (12) of them, including Dutch, English, French, German, Italian, Japanese, Korean, Polish, Russian, Simplified Chinese, Spanish, and Traditional Chinese.

As expected the initial indexing will be the most intensive and longest. Depending on the number and size of the files it can take from a few minutes to days before it can be completed.

As a comparison, the M3 Macbook can process between 30.000 and 40.000 in 24 hours, or about 100 documents in 30 minutes depending on the complexity and content.

Indexing is a taxing process for the Mac, so choose when it will happen
Indexing warning, keeping the Mac charged (notebook) and awake will expedite the whole process

Before we get carried away there are certain limitations to this search feature. While the software is not supported on mobile devices, it also does not support face recognition, tagging, or video and audio files. This does not mean it will not be supported in the future, but presently that is not the case.

The focus is on a wide range of image and document file formats including the following.

Images: jpg, jpeg, png, gif, heic, heif, bmp, tif, tiff, ico, raw, dng, nef, cr2, arw, raf, orf, sr2, rw2, pef

Documents: .pdf, docx, pptx, xlsx, ods, odt, odp, csv, txt, markdown, md, mdown, mkdn

Indexing in progress
Activity logs will allow us to follow the indexing progress and even the option to search it

In my testing, this process was the first time that I was able to hear the Mac Mini (M4 Pro) vent turn on. It was nothing loud or long for that matter, but it will spring up during the indexing phase for sure depending on how much content there is.

The search process with Deep Search can be executed using either an AI-based descriptive method or a text-recognition method (OCR). Depending on the desired result, users can toggle between these methods through the user interface for both document and image searches.

Yep Search main screen and search options

The interface also supports search filters based on type, folder destination, date, and time. These features help narrow down and accelerate the search process, thereby providing an enhanced user experience.

AI-descriptive search example

Despite testing being conducted on a Mac Mini M4 Pro, the expectation of a faster generation of image thumbnails was not met, as it can take up to 20 seconds for them to display. Initially, the images that most accurately match the semantic input are shown first. However, Deep Search may continue to list numerous images related to specific keywords, populating the grid with images that might not align with what was initially sought.

While the first few images are dead on, the rest are an input related approximations

With semantic image search, we can type descriptive phrases to find results that better match our intent. In fact, using four or more words may improve the quality of matches, as one- or two-word queries often return too much noise.

In the world of semantic search (example above), partially matched results are also shown—ranked by relevance.

While the example here is "islands", we can see that the first few images are spot on and do indeed present an island. The other images are in some way relevant to the search keyword or phrase to help when our memory is fuzzy or when the AI interprets visual elements broadly.

A single word search phrase will sometimes give a lot of options

The speed of thumbnail generation depends on both their quantity and the window size. Once enough "pages" have been scrolled, the thumbnails stop displaying, and revisiting them requires re-rendering. This process can appear sluggish; however, reducing the size leads to faster rendering. Similar to Synology Photos, users can manipulate the size or switch to a "list view" for a quicker experience. This may be a beta version aspect, with likely optimizations forthcoming. The following video showcases the current look and feel.

0:00
/1:35

Deep Search image search demo

Another observation is the delay of several seconds for images to enlarge in the right-hand "preview" pane. However, when using the open image command, the image is presented at full resolution immediately. This disparity is likely because the full view is rendered by the macOS Preview app, whereas the thumbnail and preview are generated by the BeeDrive/Deep Search window, which might require its own speed optimizations.

In addition to images inside documents (more on that later), OCR is also applied to everyday photos—making it easy to find pictures of tickets, menus slides, or even memes. Typing a phrase will allow Deep Search to locate the image for us, even if the words appear only in fine print or if it's blurry.

For students and professionals alike, especially those with folders of screenshots, it’s a powerful asset.

Text detection in images - BLACKVOID phrase detected as part of the image logo
The description under the image explains how and why AI and OCR matched the image
The level of detection "detail" is impressive. The "BeeStation" phrase was detected on an out-of-focus screen

Leveraging AI to find images is remarkably powerful; similarly, document searching, while not revolutionary, proves invaluable when necessary. Locating an exact phrase or paragraph across thousands of pages and documents can be a daunting task. With Deep Search, users are equipped with a tool that delivers extremely fast results across a vast number of pages.

Locating a phrase across multiple pages, and multiple documents in seconds
0:00
/0:54

Example of using document search capabilities of Deep Search

A notable feature is the ability to jump directly to the exact document page where the phrase is detected with a single button. This significantly reduces the time needed to locate the document, open it, and scroll to the precise spot.

A limitation of the document search is its inability to present documents based on questions. Although AI powers the tool, we cannot simply ask it, for instance, about warranty options for the DS925+. Instead, it provides results and links to document sections mentioning warranties. Essentially, this is not an AI "chatbot" but rather a search engine, and this distinction should be kept in mind.

Comparing the search speed for documents versus images is noteworthy. As demonstrated in the clip above, obtaining results and accessing the document to land on the exact page takes just a second. For those considering BeeDrive and Deep Search for handling large document collections, the performance is impressive. After the initial scan and indexing, BeeDrive transforms into a powerful yet lightweight portable knowledge base, capable of searching images using OCR as well as indexed text.

Currently in beta, the 2.0 version of BeeDrive delivers even more features. The major addition is the new Deep Search, which, while promising, could improve in areas like image presentation speed. However, I am confident that these current shortcomings will be addressed over time.

Available in 1, 2, and 4TB versions, the BeeDrive 10G DAS device now includes a valuable new feature, undoubtedly beneficial for many Mac users. With Windows support expected later this year, we anticipate further updates and enhancements, making this practical device even more versatile.