Skip to content

Ingest

The purpose of the ingest workflow is to provide new video files to the playout. After each successful upload, the corresponding file is automatically processed by Makalu. When the internal file processing is completed, the uploaded file is registered in Makalu and can be scheduled for playout. In the final step, each scheduled file (that is added to a rundown as part of a show in a playlist) is automatically transferred from the ingest storage to the playout storage. For more information, see section File transfer.

Uploading files

The ingest process starts with the file upload. For this purpose, Makalu includes the Asset Uploader, a web application for uploading files to the ingest storage.

With Makalu Asset Uploader you can either upload a new file to the system, creating a completely new asset or you can assign the file to be uploaded to a placeholder asset that already exists in the system. A placeholder is a virtual element, that can be used to schedule a file for playout, that is not yet available (that has not yet been created). By using this concept, playlists can already be prepared via the planning component, even if the actual files are created later. As a result, the uploaded file replaces the placeholder everywhere it is used in the planning component.

To upload a file, proceed as follows:

  1. Open Makalu Asset Uploader by either:

    1. Opening Makalu Automation via https://automation.customer-identifier.makalu.live and selecting the Asset Uploader tab or

    2. Opening the Makalu Asset Uploader standalone user interface via https://asset-uploader.customer-identifier.makalu.live/s3uploader

      Notice

      In both cases replace customer-identifier with your actual customer identifier, e.g. exampletv. After opening the corresponding URL, log in with your Makalu credentials.

    The Asset Uploader user interface is opened.

    Asset Uploader

    Figure: Asset Uploader - User interface

  2. Select a folder on the ingest storage as target for your upload, by clicking the Target folder sidebar icon icon on the right side to open the target folder sidebar. Then select the target folder.

    Asset Uploader - Select target folder

    Figure: Asset Uploader - Select target folder

    The folder is selected, and the sidebar is closed. The name of the selected folder is displayed above the upload list.

    Tip

    You can also create a new folder by using the Create new folder area in the target folder sidebar.

    When creating a new folder, the following restrictions apply to the folder name:

    • Do not use a leading slash but append a closing slash (Example: folder/subfolder/).
    • Not permitted (system-reserved) top-level folder names are Live, live, Placeholder and placeholder.
    • Permitted characters are letters (a-z, A-Z), numbers (0-9), hyphen (-) and underscore (_).

    To create a new folder, proceed as follows:

    1. Enter a valid name for the new folder in the Folder name field.

    2. To create the folder, click Create.

    The folder list is updated, and you can select the newly created folder as target.

  3. Optional (if you want to assign the file to be uploaded to an already existing placeholder asset): Select a placeholder as follows:

    1. Click Assign to placeholder.

      A list of available placeholders is displayed.

      Asset Uploader - List of available placeholders

      Figure: Asset Uploader - List of available placeholders

    2. Use the Search field and/or the paging buttons to search for a specific placeholder.

    3. Select a placeholder.

    4. Click Ok.

      The list of placeholders is closed, and the name of the selected placeholder is displayed right to the Assign to file button.

      Asset Uploader - Placeholder selected

      Figure: Asset Uploader - Placeholder selected

  4. To select the file to be uploaded, click Add file.

    The file selection window opens.

  5. In the selection window select one or more files and click Open.

    Notice

    If you selected a placeholder as described in the optional step 3, you can only select a single file. If no placeholder is selected, you can select multiple files.

    Notice

    Depending on how the Makalu Asset Uploader is configured, only allowed file types can be selected and uploaded. It is possible to allow any file type or to restrict the allowed file types to e.g. MP4 files only. In this case only files of this type are displayed in the selection window.

    The selected files are added to the upload list and the upload starts automatically.

    Asset Uploader - Upload started

    Figure: Asset Uploader - Upload started

    During the upload process the progress of each upload is displayed, including current upload speed, amount of uploaded data and overall upload percentage. Completed uploads are highlighted in green with the status "Upload completed".

    Notice

    The upload speed is not limited. The application will use the full upload bandwidth currently available on client side.

    Asset Uploader - Upload completed

    Figure: Asset Uploader - Upload completed

    Notice

    While uploads are in progress, you can either pause, resume, or cancel individual or all uploads via the corresponding buttons.

    Warning

    Do not close your browser while uploads are in progress! Otherwise your current upload progress will be lost.

    When a file upload is completed, the file processing starts automatically.

File processing

After each successful upload, the internal file processing is automatically triggered. When the file processing is completed, the uploaded files are registered in Makalu and can be scheduled for playout.

File processing consists of the following sub-processes:

Sub-process Purpose Input (uploaded) file format Output file format
Creating a low-res (proxy) video file

Notice: This is only necessary, if original files are uploaded in a format other than MP4.
Web-based preview of the video file MXF or any other source video format MP4
Creating a thumbnail image Display the image in the user interface Created from uploaded source video file PNG
Creating a proxy subtitle file

Notice: This is only necessary, if matching subtitles are uploaded for the original video file.
Web-based preview of the video file including subtitles SRT, STL, TTML VTT
Determining technical metadata Optimized internal file processing, display file information in the user interface Created from uploaded source files XML
Creating a checksum for original and proxy files Check if files were correctly transferred from ingest storage to playout nodes - -

Previewing uploaded files

For previewing uploaded files, Makalu includes the Asset Viewer web application.

To preview uploaded and processed files, proceed as follows:

  1. Open the following URL in your browser:

    https://asset-viewer.customer-identifier.makalu.live.

    Notice

    Replace customer-identifier with your actual customer identifier, e.g. exampletv.

  2. Log in with your Makalu credentials.

    The Makalu Asset Viewer user interface is opened.

    Asset Viewer

    Figure: Asset Viewer - User interface

  3. Use the folder tree on the left side to select the folder that contains the file to be previewed.

    All video files included in the selected folder are listed in the Parent Assets area.

    Asset Viewer - Folder selected

    Figure: Asset Viewer - Folder selected

  4. Select the file to be previewed from the Parent Assets list.

    The selected file is opened in the preview player on the right side. Corresponding files are listed below in the Child Assets area.

    Asset Viewer - File selected

    Figure: Asset Viewer - File selected

  5. Use the player controls to preview the file.

    Asset Viewer - Previewing a file

    Figure: Asset Viewer - Previewing a file

Housekeeping

Makalu provides two workflows for deleting files no longer needed within the scope of housekeeping: automatic and manual.

Both workflows include the following steps:

  1. Removing the file internally from the Makalu system by removing all corresponding database entries

  2. Deleting the file from the ingest storage

  3. Deleting the file from local storage on playout instances

Automatic housekeeping

Automatic housekeeping deletes files automatically based on their expiry date. This time period is configured globally, and the actual expiry date is calculated individually for each uploaded file based on this setting. When the expiry date is reached, a configurable grace period starts. After the end of this period the corresponding file is automatically deleted.

It is possible to configure protected folders, that are excluded from housekeeping. Files uploaded to these folders are never automatically deleted, even if the global expiry date is reached.

Manual housekeeping

Manual housekeeping allows you to delete uploaded files at any time (regardless of the global expiry date) via Makalu Asset Viewer.

To delete a file manually, proceed as follows:

  1. Open the following URL in your browser:

    https://asset-viewer.customer-identifier.makalu.live.

    Notice

    Replace customer-identifier with your actual customer identifier, e.g. exampletv.

  2. Log in with your Makalu credentials.

    The Makalu Asset Viewer user interface is opened.

    Asset Viewer - User interface

    Figure: Makalu Asset Viewer - User interface

  3. Use the folder tree on the left side to select the folder that contains the file to be deleted.

  4. Select one or more files to be deleted from the Parent Assets list.

  5. Click Delete selected.

    Asset Viewer - Delete files

    Figure: Makalu Asset Viewer - Delete files

  6. Confirm the dialog by clicking Delete.

    The selected files are deleted.

Instead of deleting a file immediately, you can also set the expiry date manually. As a result the file is deleted at a later time when expiry date and grace period have expired.

To set the expiry date manually, proceed as follows:

  1. Repeat steps 1 and 2 as described under Manual housekeeping.

  2. In the Parent Assets list click the current expiry date of the corresponding file in the Expires column.

    A date picker is displayed.

    Asset Viewer - Setting the expiry date of a file manually

    Figure: Makalu Asset Viewer - Setting the expiry date of a file manually

  3. Select the new expiry date.

    The expiry date is updated.

    Asset Viewer - Expiry date of a file set manually

    Figure: Makalu Asset Viewer - Expiry date of a file set manually

    Tip

    Alternatively you can prevent a file from being deleted by the automatic housekeeping. To do this, set the expiry date to Never by clicking the corresponding button in the date picker.