Skip to content

Data management

Once your data model is ready, you're able to add data. The DSP-APP offers several possibilities to add data, whether you are starting from scratch or importing data from another program.

Start from scratch

NOT YET IMPLEMENTED (only mockups are presented)

When a project starts from scratch, you will enter and generate new data directly in the DSP-APP itself. Generating new data can be done one by one with a form or with a table-based (Excel like) tool.

  • Upload the files, e.g., the actual audio file of an interview or images of the photographs discussed in the interview
  • Augment the metadata
  • In case of interview transcriptions from audio or video files, DSP-APP will offer a simple transcription tool

Create new source e.g. upload audio file of an interview.Create new source; e.g. upload audio file of an interview.


Organize data and create additional sources

NOT YET IMPLEMENTED

The workspace of the DSP-APP includes tools to connect different sources, even if they're not in the same project (linkage), to comment on a source and on their metadata fields (annotate), and to transcribe audio-visual material. These actions will generate more data and will help to find specific sources and their relations easily. It's possible to collect different sources and to store them in an individual collection. You can define more than one collection. You can share collections and invite other users to collaborate.


Search and browse

DSP-APP offers the possibility to the user to search in 3 different ways: full text search, advanced search and expert search (Gravsearch query). The search bar is always available in the header of each page, whether logged in or out.

Search bar with the 3 search modes: full text, advanced and expert

Full text search performs queries including one or more terms or phrases, and returns data that matches search conditions. By default, the search is performed in all projects stored in DSP. However, it is possible to filter by project using the menu "Filter by project" on the left side of the search bar.

Filter your full text search by specific projecthttps://admin.dasch.swiss - Search 1: Full text search

When clicking on the search bar, the search history panel is displayed. The 10 last searches are registered. It is also possible to clear the search history list (Clear list button at the bottom of the panel).

Search history panelSearch history list is accessible for the full text search from any webpage.

Special syntax:

  • asterisk* can be used as a wildcard symbol
  • "quotation marks" searches for the whole pattern

Advanced search link is findable in the search menu at the right of the full text search field.

The advanced search allows for the creation of complex queries using a graphical widget. The widget's contents are then turned into a string representing a Gravsearch (SPARQL) query to be sent to DSP-API.

A query consists of the following elements: - data model selection - selection of a resource class belonging to the selected data model (optional) - specification of properties, comparison operators, and values (optional).

Although selection of a resource or a property or both are optional, either a resource class has to be selected or at least one property has to be specified, otherwise the query is not considered valid and cannot be submitted.

Search 2: Advanced search offers many filter combinations and is a powerful search tool.https://admin.dasch.swiss/search/advanced - Search 2: Advanced search offers many filter combinations and is a powerful search tool.

Comparison Operators

Depending on the value type of the chosen property, one or more of the following comparison operators can be selected:

  • is equal to: value equality: same number, exact same string, overlap of date periods, same target resource.
  • is not equal to: value inequality: not same number, not exact same string, no overlap of date periods, not same target resource.
  • is greater than: value comparison: number is greater than search value, date period begins after search value.
  • is greater than or equal to value equality / value comparison: number is equal to or greater than search value, overlap of date periods or date period begins after search value.
  • is less than: value comparison: number is less than search value, date period ends before search value.
  • is less than or equal to: value equality / value comparison: number is equal to or less than search value, overlap of date periods or date period ends before search value.
  • exists: value for the given property exists.
  • is like: search value is contained in a text using the SPARQL REGEX function (supports regular expressions).
  • matches:
  • text property: search value matches the text (Lucene Query Parser Syntax).
  • linking property: matches the specified linked resource.

Search Examples

Regular Expressions (is like)

The is like operator lets the user search for texts that are like the search value via the support of regular expressions In this example, all books are found whose title contains "Narrenschiff" followed by a space and some other characters like "(lat.)" or "(dt.)".

For general information about regular expressions see this interactive tutorial.

Advanced search panel with a search example

Lucene Parser Syntax (matches)

Used with a text property, the matches operator lets the user search for texts that match the search value, supporting Lucene Query Parser Syntax. In this example, all persons are found whose names contain "Ja" and "ob" with a character in between (represented by the wildcard "?"). This search finds "Jacob" as well as "Jakob".

Note the difference between regular expressions and Lucene parser syntax!

Advanced search panel with a search example

Specifying a Linked Resource (matches)

Used with a linking property, the matches operator lets the user search for a linked resource that matches the specified properties. In this example, the user writes a query looking for all letters that have an author that: 1. was born after January 1st 1650 2. whose family name is "Bernoulli"

This is different from the "is equal to" operator that lets the user specify a certain person (selected from a list).

Advanced search panel with a search example


Expert search link is findable in the search menu at the right of the full text search field.

The expert search can be more powerful than the advanced search, but requires knowing how to use the query language Gravsearch (based on SparQL and developed by the DaSCH team). With Gravsearch, expert users can build searches by combining text-related criteria with any other criteria.

For example: you could search for a page in a manuscript that contains a certain element and also mentions a person, who lived in the same country as another person, who is the author of another author.

Expert search is a text area in which you can create Gravsearch queries.https://admin.dasch.swiss/search/expert - Search 3: Expert search is a text area in which you can create Gravsearch queries. Here is the default example you can find in the app.

To learn Gravsearch, go to the DSP-API documentation → Gravsearch


Search results

Simple list

The results of the search are displayed in an organised list with a small preview. You can select one result at a time to get more information.

Search result 1: Simple list of results, similar to Google's list of results.Search result 1: Simple list of results, similar to Google's list of results.

NOT YET IMPLEMENTED It is not possible yet to sort or order by criteria when searching with the full text search, use the advanced search or the expert search instead to get back sorted results.


Grid list: Lighttable

NOT YET IMPLEMENTED

The results of the search are displayed in a grid list with a big preview. You can select one result at a time to get more information.

Search result 2: A kind of preview list, inspired by Pinterest.com.Search result 2: A preview list where the results are presented in tiles.


Table: Excel-like view

NOT YET IMPLEMENTED

The search results are displayed in a table with the option to sort them. This layout is enabled when the search has been performed with only one source type. Each column of the table corresponds to one metadata.

Search result 3: An Excel-like table view to edit multiple sources at once.Search result 3: An Excel-like table view to edit multiple sources at once.


Do research and work on your data

Once you have found the desired sources, you can (re)view them and annotate the source itself, the media file, or single metadata values. If you select more than one source, you can compare them in a side-by-side view, link them, edit them all at once, or save them in a collection. A collection is similar to a playlist in a music app or shopping basket in an online store.

Display a source

WORK IN PROGRESS

The DSP-APP offers different source views for different media types. There's a viewer for still images, moving images, audio and document files. You can open them from the list of search results. Depending on the media type, DSP-APP offers different tools to work on the source.

In a still image source, you're able to draw regions on the image and to annotate or transcribe this region. Usually, a still image source is used for book pages, photographs, postcards, letters etc.

In time-based sources like moving image or audio document, you can mark sequences on the timeline. A transcription tool helps to annotate and to transcribe the sequence.

Single source view. The source type in this example is "Photo".Single source view. The source type in this example is "Page".

DSP-APP will offer a graph view to visualize the connection of a selected source. The graph view is a powerful tool because you will find more information about the source by clicking through the nodes.

Graph view of a single source.Graph view of a single source.

Additionally, you can work on the source directly, e.g, transcribe a moving image or a taped interview or mark regions of interest on still images and on documents.

Single source fullframe view with the transcription tool at the bottom. The source type in this example is "Video" with a table-based sequence protocol on the right hand-side.Single source fullframe view with the transcription tool at the bottom. The source type in this example is "Video" with a table-based sequence protocol on the right hand-side.


Select more than one source

NOT YET IMPLEMENTED

Three sources selected; what do you want to do with them?Three sources are selected; what do you want to do with them?

By selecting more than one source, you will be able to edit them all at once, add them to a collection, share or connect them. Or you could compare the sources (see Compare the sources).


Compare the sources

NOT YET IMPLEMENTED

You will be able to compare from two to six source objects at the same time side by side.

Compare 2 to 6 sources with each other, similar to the Mirador web app.Compare 2 to 6 sources with each other, similar to the Mirador web app.


Annotate and connect your data (sources and/or metadata)

NOT YET IMPLEMENTED

A main feature of the flexible data storage that DSP-APP uses is the possibility to annotate and link sources and their metadata. An annotation can be a small note about a date like "Not sure about the birthdate of this person. There's another date mentioned in the source XYZ". Inside the note, it will be possible to link to another source.

Links in DSP-APP are always bi-directional. If you link source A with source B, then source B knows about this connection. If you find source B, you have the connection to source A as well.


Export, save or share the data

NOT YET IMPLEMENTED

Data sets and metadata extracted through a search can be exported as CSV, XML, or other predefined file formats. It will be also possible to store full text, advanced, and expert search queries to reuse them later, collect source objects in a collection similar to a playlist of a music app or a shopping basket.

The share menu offers many tools to export the data, to send it to someone or to store it in an individual source collection.The share menu offers many tools to export the data, to send it to someone or to store it in an individual source collection.


Last update: 2021-09-08